🖨️
DataSF | Publishing Process
  • Introduction
  • Why Publish Data?
    • Publishing Data Standards
  • Publishing Specifications
    • Kickoff
      • Breadcrumbs and Inventory
    • Privacy Toolkit
      • Privacy Toolkit Form
    • Security Toolkit
  • Data Pipeline
    • Pipeline Basics
      • Manual Publishing
      • Data Pipeline
      • Common Transformations
  • Metadata
    • Intro to Metadata
      • Metadata Standards
  • Publishing & Maintenance
    • Review & Publishing
    • See our other explainers
Powered by GitBook
On this page
  • Welcome!
  • 1. Publishing Specifications
  • 2. Create a data pipeline
  • 3. Writing Metadata
  • 4. Publishing and Maintenance

Introduction

Overview of the data publishing process

NextWhy Publish Data?

Last updated 1 year ago

Welcome!

This document will give an overview of San Francisco's data publishing process; the steps you need to take to get your department's data published on the . Not every step will be required for every dataset but in general, these are the steps you will take.

1.

This group of steps will get your dataset ready to be published. By completing them you will:

  • Kick Off the process with DataSF

  • Update the data Inventory and create Breadcrumbs

  • Assess any privacy risks

  • Assess any security risks

  • Review your final data specification

2.

This step will move the data from your departments database to the open data portal - there are many ways to do this, but at a high level they can be broken down to manually updating your dataset or setting up an automated process.

3.

This step is all about helping people understand your data and get the most out of it. We have written standard to help you do just this.

4.

You've done the hard work, this is the final review before releasing your data to the public.

For any additional questions, please reach out to:

  • dan.tonkovich@sfgov.org (program manager for open data)

  • and cc: datasf@sfgov.org

Open Data Portal
Publishing Specifications
Create a data pipeline
Writing Metadata
Publishing and Maintenance