DSDSD - Provenance Research in Gray Systems Lab at Microsoft
Provenance encodes information that connects datasets, their generation workflows, and associated metadata (e.g., who or when executed a query). As such, provenance is instrumental for a wide range of enterprise applications, including governance, auditing, and observability. As provenance becomes more prevalent across enterprise applications, research and engineering need to work in tandem to define, develop, and optimize provenance functionality. To this end, at Microsoft’s Gray Systems Lab (GSL), we have identified provenance capture, provenance querying, and provenance-aware applications as key domains for provenance research and research engineering. In this talk, I will present selected projects we have been working on in GSL, along with key challenges and lessons learned, per research area. Regarding provenance capture, I will first present OneProvenance, an engine that captures dynamic, coarse-grained provenance from database logs efficiently and effectively; OneProvenance is c
Provenance Research in Gray Systems Lab at Microsoft Fotis Psallidas Provenance encodes information that connects datasets, their generation workflows, and associated metadata (e.g., who or when executed a query). As such, provenance is instrumental for a wide range of enterprise applications, including governance, auditing, and observability. As provenance becomes more prevalent across enterprise applications, research and engineering need to work in tandem to define, develop, and optimize provenance functionality. To this end, at Microsoft’s Gray Systems Lab (GSL), we have identified provena
Explore this link on the map →related reading
- Provenance - Wikipediaen.wikipedia.org
- Gap Mapgap-map.org
- Bridging the Scientific Knowledge Gap and Reproducibility: A Survey of Provenance, Assertion and Evidence Ontologies - PMCpmc.ncbi.nlm.nih.gov
- Elicit: AI for scientific researchelicit.org
- Elicit: AI for scientific researchelicit.com
- Omar Rizwan on X: "it feels like we keep orbiting this: a programming system where when you have a value, say `4`, it always comes with a provenance? (did it come from evaluating `2+2`, did you prompt the user and they typed in `4`, etc: thtwitter.com
- Data Journey First DataOps | DataKitchendatakitchen.io
- Shreya Shankarshreya-shankar.com
- Reducto: The Agentic Document Platform for AI Teamsreducto.ai
- GitHub - awesomedata/awesome-public-datasets: A topic-centric list of HQ open datasets. · GitHubgithub.com
- Homepage of Christopher Re (Chris Re)cs.stanford.edu
- Loss Functions in Machine Learning Explained | DataCampdatacamp.com