A Scalable, Open Source Platform for Data Processing, Archiving and Dissemination
Abstract
Building on the Object Oriented Data Technology (OODT) big data toolkit developed by NASA and the Work-flow INstance Generation and Selection (WINGS) scientific work-flow system developed by the Information Sciences Institute at the University of Southern California, we focused analytics and work-flows appropriate to several challenge big data problems and demonstrated the utility of OODT-WINGS in addressing them. Specific demonstrated analyses address i) crawling and indexing the XNET contents in a quick-reaction demonstration in January 2013, ii) a "data triage" characterization of the Kiva loan system, iii) contributory work done on 5 of 6 XDATA summer 2013 workshop challenge problems, and iv) demonstration of end-to-end processing work-flow in conjunction with the USC Institute for Creative Technologies end-user interface at the September 2013 DARPA open house. Two papers published during this time addressed i) the overall "data triage" use case, and II) work flow characterization during time-bounded operations.
Document Details
- Document Type
- Technical Report
- Publication Date
- Jan 01, 2016
- Accession Number
- AD1004395
Entities
People
- Chris Mattmann
- Samuel D Park
- Yolanda Gill
Organizations
- MDA Information Systems (United States)