luisomoreau/ei-transform_create-graphs repository overview
Create graphs from sensors CSV file (Python)
This transformation block generate graphs from sensor CSV files.
Setup
Operating mode: Standalone (--standalone)
Parameters:
--bucket_name Bucket where your dataset is hosted
--bucket_directory Directory in your bucket where your dataset is hosted
--sensor_name Sensor data to extract to create the graph, this should match the name of the file
[
{
"name": "Sensor",
"type": "string",
"param": "sensor_name",
"value": "Accelerometer",
"help": "Sensor data to extract to create the graph, this should match the name of the file"
},
{
"name": "Bucket",
"type": "bucket",
"param": "bucket_name",
"value": "",
"help": "Bucket where your dataset is hosted"
},
{
"name": "Path in bucket",
"value": "",
"type": "string",
"param": "bucket_directory",
"help": "Directory in your bucket where your dataset is hosted"
}
]
Test the transformation block locally
The dataset used to test this transformation is accessible here: https://www.kaggle.com/datasets/luisomoreau/activity-detection.
In production, the MOUNT_PREFIX will be set to /mnt/s3fs/. Locally, you can overwrite this mount prefix using the following command:
export MOUNT_PREFIX=''
Run the script:
python3 transform.py --bucket_name ../dataset --sensor_name Accelerometer
Run job
Tag summary
Content type
Image
Digest
sha256:4af6480cd…
Size
173 MB
Last updated
almost 3 years ago
docker pull luisomoreau/ei-transform_create-graphs