instagis/fb-data-collector repository overview

⁠Facebook Data Collector 2.0 (FBDC2)

The objective of this project is to collect various kinds of information from the Facebook social network and store the collected data in a database suitable for analytics use.

⁠Project Dashboard

⁠Development

⁠Hosting

⁠Logs

⁠Technical Requirements

• Python 3.5
• PostgreSQL 9.6 server
• PostgreSQL 9.6 client
• Bash

⁠Directory Structure

• .circleci/: CircleCI 2.0 configuration.
• bin/: Scripts and utilities.
• docs/: Documentation.
• db/: Database-related files.
• ig_fbdc/: Main package.
  • access_token/: Facebook Access Token module.
  • app/: Facebook App module.
  • base/: Base classes.
  • config/: Configuration.
  • insights/: Facebook Insights module.
  • lib/: Libraries.
  • page/: Facebook Page module.
    • insights/: Facebook Page Insights module.
    • metadata/: Facebook Page Metadata module.
    • post/:
      • comment/: Facebook Page Post Comment module.
        • comment_reply/: Facebook Page Post Comment Reply module.
      • insights/: Facebook Page Post Insights module.
      • reaction/: Facebook Page Post Reaction module.
      • reaction_count/: Facebook Page Post Reaction Count module.
  • partitioning/: Database partitioning module.
  • tasks/: CLI tasks.
  • user/: Facebook User module.
• ig_fbgraph/: Facebook Graph API wrapper.
• make/: Make task definitions.

⁠Development

Always activate the virtualenv before running any command.

⁠Linting

Run make lint.

⁠Testing

Run make test.

⁠Test Coverage

Run make test-coverage.

⁠Documentation

For more information, including configuration and usage instructions, read the documentation⁠.