laneolson/data-pipeline repository overview

⁠data-pipeline

A docker environment with tippecanoe, mapshaper, R, csvkit, python, node, etc. ready to go

⁠Common Tasks

⁠Extracting Data

• From static files on S3
• From API endpoints
• From U.S. Census (Geometry + Data)

⁠Transforming Data

• Join / Merge / Group / Split
• JSON
• Static CSV
• GeoJSON
• Vector Tiles

⁠Loading Data

• Static file to Database
• Uploading to S3
• Deploying vector tiles to Mapbox