DSDSD - Provenance Research in Gray Systems Lab at Microsoft
Provenance encodes information that connects datasets, their generation workflows, and associated metadata (e.g., who or when executed a query). As such, provenance is instrumental for a wide range of enterprise applications, including governance, auditing, and observability. As provenance becomes more prevalent across enterprise applications, research and engineering need to work in tandem to define, develop, and optimize provenance functionality. To this end, at Microsoft’s Gray Systems Lab (GSL), we have identified provenance capture, provenance querying, and provenance-aware applications as key domains for provenance research and research engineering. In this talk, I will present selected projects we have been working on in GSL, along with key challenges and lessons learned, per research area. Regarding provenance capture, I will first present OneProvenance, an engine that captures dynamic, coarse-grained provenance from database logs efficiently and effectively; OneProvenance is c
Provenance Research in Gray Systems Lab at Microsoft Fotis Psallidas Provenance encodes information that connects datasets, their generation workflows, and associated metadata (e.g., who or when executed a query). As such, provenance is instrumental for a wide range of enterprise applications, including governance, auditing, and observability. As provenance becomes more prevalent across enterprise applications, research and engineering need to work in tandem to define, develop, and optimize provenance functionality. To this end, at Microsoft’s Gray Systems Lab (GSL), we have identified provena
related reading
- Provenance-Aware Knowledge Representation: A Survey of Data Models and Contextualized Knowledge Graphslink.springer.com
- Provenance - Wikipediaen.wikipedia.org
- Elicit: AI for scientific researchelicit.org
- Datacurve | The data engine for frontier AIdatacurve.ai
- Eden Wu — PhD researcher at TU Grazedenwuyifan.github.io
- Bridging the Scientific Knowledge Gap and Reproducibility: A Survey of Provenance, Assertion and Evidence Ontologies - PMCpmc.ncbi.nlm.nih.gov
- Shreya Shankarshreya-shankar.com
- GitHub - awesomedata/awesome-public-datasets: A topic-centric list of HQ open datasets. · GitHubgithub.com
- engblogsengblogs.dev
- Sundial: Opinionated Intelligence for data teamssundial.ai
- Claude Science (beta) | Claude by Anthropicclaude.com
- Jaya Gupta (@JayaGup10) on Xx.com