Public Repository

Last pushed: 19 days ago
Short Description
Container-converged data services, base image for NexentaEdge DevOps Edition
Full Description

NexentaEdge DevOps Edition

NexentaEdge DevOps Edition is a purpose built and packaged software stack for providing a scale-out infrastructure for containerized applications. It is designed to make it easy to integrate an enterprise class storage system with existing networking and compute services into a single solution.

NexentaEdge DevOps Edition nodes are deployed as containers on physical or virtual hosts, pooling all their storage capacity and presenting it as native block devices (NBD), iSCSI, NFS shares, or fully compatbile S3/SWIFT object access for containerized applications running on the same servers. All storage services are managed through standard Docker tools, for greater agility and scalability.

NexentaEdge Extended S3 API

NexentaEdge Extended S3 API provides unique benefits which can be useful for Machine Deep Learning, Big Data and IoT frameworks:

• Mount S3 objects for fast File/POSIX access avoid unnecessary copy, fetch only needed datasets
• Extended S3 feature set Append, Range Writes, Object/Bucket snapshots, Key-Value Object access
• Data Reduction with global inline de-duplication, compression and erasure encoding
• Cost Reduction File/Block/DB access with S3 economics

Use cases details:

• Advanced Versioned S3 Object Append and RW "Object as File" access
• S3 Object as a Key-Value database, including integrations w/ Caffe, TensorFlow, Spark, Kafka, etc
• High-performance Versioned S3 Object Stream Session (RW), including FUSE library to mount an object
• Management API for Snapshots and Clones, including Bucket instantaneous snapshots
• Transparent NFS to/from S3 bucket access, “ingest via NFS, read via S3” or vice-versa

Comparision to existing cloud object storage APIs:

Give Edge-X S3 a try in easy to run single command installation:

    mkdir /var/tmp/data
    docker run --name s3data -v /etc/localtime:/etc/localtime:ro -v /var/tmp/data:/data -d \
            nexenta/nedge start -j ccowserv -j ccowgws3
    docker exec -it s3data neadm system status
    docker exec -it s3data neadm system init

NexentaEdge for Container-Converged Infrastructures

NexentaEdge purpose built Software Stack enables third-party vendors to deliver complete end-user solutions with benefits of component re-usability and unique feature set.

NexentaEdge DevOps Edition provides advanced storage features of NexentaEdge to containerized applications:

  • Deployed as containers and managed using standard container tools (DevOps style)
  • Deployed as full Software Stack, including Enterprise grade GUI and features: availability, managability and scalability
  • Docker Volume drivers for File (NFS) and Block (NBD)
  • Scale-out high performance data layer that provide self-healing error correction and automatic load balancing
  • Scale-out high performance metadata layer with global Name Spaces and built-in multi-tenancy support
  • Unlimited number of space optimized snapshots and clones
  • Inline cluster wide deduplication and compression
  • Off-line "Quick" Erasure Coding without performance penalty on writes or reads with distributed rebuild
  • Micro-services for data access to Scale-Out File (NFS), Scale-Out Block (NBD/iSCSI), and Object (S3/SWIFT) services
  • Protocol transparency. Objects/Files/LUNs can be accessed from any protocol - NFS, S3 or SWIFT
  • Quality of Service for storage services (per-tenant controlled rate limiting)
  • Multi-site high-performance bi-directional continuous and "one-shot" replication
  • High performance Raw Disk backend designed for All-Flash, Hybrid (HDD/SSD) and large capacity HDDs

Deploy Container-Converged infrastructure following automatic procedure (Enterprise style)

Or continue with more examples and deploy Quick Start Guides (DevOps style)

Please join us at the NexentaEdge Devops community site.

Ask immediate question on NexentaEdge Developers Channel

Note: The full documentation for NexentaEdge Enterprise Edition is available here.

Docker Pull Command