Conformance — measured against real SDKs
Every Vyomi release is gated by an SDK conformance suite that drives the unmodified official AWS, GCP, and Azure SDKs against a fresh appliance. Builds below the public threshold don't ship. Numbers on this page are from the most recent green build.
Per-cloud breakdown
Pass rates broken out by cloud + SDK. The harness runs with space isolation enabled and a published floor of 85.0% — anything below blocks the release.
| Cloud | SDK / CLI | Test target | Status |
|---|---|---|---|
| AWS | boto3 (Python) | S3 · DynamoDB · SQS · IAM · EC2 | PASS |
| aws CLI v2 | 15 smoke tests + service mix | 15 / 15 PASS | |
| aws-sdk-java v2 | S3 · DynamoDB · SQS · IAM · EC2 | 11 / 13 PASS (chunked encoding off) | |
| aws-sdk-go-v2 | S3 · DynamoDB · SQS · IAM · EC2 | 14 / 14 PASS | |
| GCP | google-cloud-* (Python) | Storage · Pub/Sub · Firestore · Cloud SQL | PASS |
| gcloud + gsutil + bq | ~150 commands | PASS | |
| google-cloud-java | Cloud Storage · Pub/Sub · Firestore admin | PASS | |
| google-cloud-go | Storage · Pub/Sub · Firestore (incl. FN-LRO, shared, admin variants) | PASS | |
| Azure | az CLI | 6 smoke tests | 6 / 6 PASS |
| azure-sdk-for-python | Storage · SQL · Service Bus · Cosmos | PASS | |
| azure-sdk-for-java | armcompute · armstorage · armsql · armservicebus · armcosmos | 5 / 5 PASS | |
| azure-sdk-for-go | armcompute · armstorage · armsql · armservicebus · armcosmos | PASS |
Service-by-service depth
Where each service stands on the conformance scale. Items at PASS have SDK round-trips exercising all core operations. PARTIAL means the service works but one or more documented gaps exist.
| Service | AWS | GCP | Azure |
|---|---|---|---|
| Object storage | PARTIAL S3 (chunked) | PASS GCS | PASS Blob |
| Compute | PASS EC2 | PASS Compute Engine | PASS VMs |
| Functions | PASS Lambda | PASS Cloud Functions | PASS Function Apps |
| Relational SQL | PASS RDS | PASS Cloud SQL | PASS Azure SQL |
| NoSQL | PASS DynamoDB | PASS Firestore | PASS Cosmos |
| Messaging | PASS SQS | PASS Pub/Sub | PARTIAL Service Bus (REST only) |
| Eventing | PASS EventBridge | PASS Eventarc | PASS Event Grid |
| IAM / Policy | PASS IAM | PASS IAM | PASS RBAC |
| Secret management | PASS Secrets Manager | PASS Secret Manager | PASS Key Vault |
| Key management (KMS) | PARTIAL KMS (2 algos) | PARTIAL Cloud KMS (2 algos) | PASS Key Vault Keys |
| API gateway | PASS API Gateway | PASS API Gateway | PASS APIM |
| Virtual network | PASS VPC | PASS VPC Network | PASS VNet + NSG |
Known deviations
Three acknowledged gaps account for the difference between observed 88% and 100%. We test them explicitly so they don't silently regress. Each has a tracking issue.
-
AWS S3 aws-chunked encoding — aws-sdk-java v2's
default PUT body framing isn't de-chunked yet. Java tests pass
with
.chunkedEncodingEnabled(false). Affects boto3 + aws-cli only when explicitly enabled (not default). - KMS encrypt/decrypt — 2 warnings under non-default algorithms. Roundtrips with standard symmetric + RSA-OAEP work end-to-end across AWS KMS, GCP Cloud KMS, and Azure Key Vault.
- MinIO read-through cache — 1 failure on rapid PUT-then-GET inside the same connection. The simulator's S3 proxy refreshes from MinIO eagerly to mitigate.
Coverage matrix · Architecture & Real Backends · Back to API Reference