# Overcast compatibility report, v0.0.1-alpha.44

> Tested compatibility across six AWS SDKs, the AWS CLI and the CDK, with the reason for every result that does not pass.

Of the 5595 results that measure Overcast, 4894 pass (87.4%). 701 results are for Overcast to fix, 2125 are tests not yet written or settled for a client, and 169 operations have no test. A test not yet written for a language, an operation an SDK cannot call, or a test blocked by an earlier failure is left out of the rate.

The full data is the `compat-report.json` asset on the release, https://github.com/overcast-sh/overcast/releases/tag/v0.0.1-alpha.44. Every result can be searched at https://overcast.sh/compat/explore/.

## Why results do not pass

### Overcast gaps (1219)

Results Overcast itself has to fix: behaviour that differs from AWS, operations with no emulation yet, and the steps those block.

- [Not emulated yet](https://overcast.sh/compat/reason/not-emulated/index.md) (701): Overcast returned 501 Not Implemented: the operation has no emulation yet.
- [Blocked by an earlier step](https://overcast.sh/compat/reason/dependency-failed/index.md) (518): An earlier test in the same group failed, so this one could not run. Fixing the first failure unblocks it.

### Test coverage gaps (2125)

Tests that have not been written or settled for a language yet. Overcast may well handle these calls; nothing has checked.

- [Test not written for this SDK](https://overcast.sh/compat/reason/suite-not-written/index.md) (2089): Overcast may well support this; the test has not been written in this language yet.
- [New test, still soaking](https://overcast.sh/compat/reason/candidate/index.md) (36): A test generated from the AWS model that has not yet run cleanly enough times to count.

### SDK limits (1)

Operations an SDK or the CLI has no API for, so there is nothing to call.

- [Not in this SDK](https://overcast.sh/compat/reason/sdk-lacks-api/index.md) (1): The SDK or CLI has no API for this operation, so there is nothing to test.

### Not tested (169)

Operations with no test at all. The generator declined to write one and recorded why.

- [Not tested](https://overcast.sh/compat/reason/untested/index.md) (169): No test exists for this operation. The generator declined to write one, and says why.

## By service and client

Passing results over results that measure Overcast.

| Service | Rate | AWS SDK for JavaScript v3 | AWS SDK for Python (boto3) | AWS SDK for Go v2 | AWS CLI v2 | AWS CDK | AWS SDK for Java 2.x | AWS SDK for .NET | AWS SDK for Rust |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| [API Gateway](https://overcast.sh/compat/apigateway/index.md) | 100% | 12/12 | 12/12 | 12/12 | 12/12 | — | 12/12 | no test | no test |
| [AppConfig](https://overcast.sh/compat/appconfig/index.md) | 56.3% | no test | no test | no test | 31/55 | — | no test | no test | no test |
| [AppConfigData](https://overcast.sh/compat/appconfigdata/index.md) | 100% | no test | no test | no test | 10/10 | — | no test | no test | no test |
| [AppSync](https://overcast.sh/compat/appsync/index.md) | 100% | 50/50 | 50/50 | 50/50 | 50/50 | — | 50/50 | no test | no test |
| [Backup](https://overcast.sh/compat/backup/index.md) | 74.1% | no test | no test | no test | 23/31 | — | no test | no test | no test |
| [Batch](https://overcast.sh/compat/batch/index.md) | 0% | 0/11 | 0/11 | 0/11 | 0/11 | — | 0/11 | 0/11 | 0/11 |
| [CDK stacks](https://overcast.sh/compat/cdk/index.md) | 100% | — | — | — | — | 35/35 | — | — | — |
| [Cloud Map](https://overcast.sh/compat/servicediscovery/index.md) | 0% | 0/3 | 0/3 | 0/3 | 0/3 | — | 0/3 | 0/3 | 0/3 |
| [CloudFormation](https://overcast.sh/compat/cloudformation/index.md) | 100% | 12/12 | 12/12 | 12/12 | 12/12 | — | 12/12 | no test | no test |
| [CloudFront](https://overcast.sh/compat/cloudfront/index.md) | 100% | 47/47 | 47/47 | 47/47 | 47/47 | — | 47/47 | no test | no test |
| [CloudWatch Logs](https://overcast.sh/compat/cloudwatch-logs/index.md) | 100% | 22/22 | 22/22 | 22/22 | 22/22 | — | 22/22 | 17/17 | 17/17 |
| [Cognito](https://overcast.sh/compat/cognito/index.md) | 100% | 22/22 | 22/22 | 22/22 | 22/22 | — | 22/22 | 9/9 | 9/9 |
| [DynamoDB](https://overcast.sh/compat/dynamodb/index.md) | 100% | 23/23 | 23/23 | 23/23 | 23/23 | — | 23/23 | 23/23 | 23/23 |
| [EC2 / VPC](https://overcast.sh/compat/ec2/index.md) | 100% | 31/31 | 31/31 | 31/31 | 31/31 | — | 31/31 | no test | no test |
| [ECR](https://overcast.sh/compat/ecr/index.md) | 100% | no test | no test | no test | 29/29 | — | no test | no test | no test |
| [ECS](https://overcast.sh/compat/ecs/index.md) | 100% | 16/16 | 16/16 | 16/16 | 16/16 | — | 16/16 | no test | no test |
| [EFS](https://overcast.sh/compat/efs/index.md) | 100% | 5/5 | 5/5 | 5/5 | 5/5 | — | 5/5 | no test | no test |
| [EKS](https://overcast.sh/compat/eks/index.md) | 100% | no test | no test | no test | 53/53 | — | no test | no test | no test |
| [ElastiCache](https://overcast.sh/compat/elasticache/index.md) | 100% | 12/12 | 12/12 | 12/12 | 12/12 | — | 12/12 | no test | no test |
| [ELBv2](https://overcast.sh/compat/elastic-load-balancing/index.md) | 0% | 0/4 | 0/4 | 0/4 | 0/4 | — | 0/4 | 0/4 | 0/4 |
| [EventBridge](https://overcast.sh/compat/eventbridge/index.md) | 100% | 30/30 | 30/30 | 30/30 | 30/30 | — | 30/30 | 19/19 | 19/19 |
| [Glue](https://overcast.sh/compat/glue/index.md) | 100% | 11/11 | 11/11 | 11/11 | 11/11 | — | no test | no test | no test |
| [IAM](https://overcast.sh/compat/iam/index.md) | 74% | 118/157 | 118/157 | 118/157 | 118/157 | — | 118/157 | 118/157 | 72/111 |
| [Kinesis](https://overcast.sh/compat/kinesis/index.md) | 100% | 17/17 | 17/17 | 17/17 | 17/17 | — | 17/17 | 10/10 | 10/10 |
| [KMS](https://overcast.sh/compat/kms/index.md) | 92.7% | 51/55 | 51/55 | 51/55 | 51/55 | — | 51/55 | 51/55 | 51/55 |
| [Lambda](https://overcast.sh/compat/lambda/index.md) | 100% | 24/24 | 24/24 | 24/24 | 23/23 | — | 24/24 | 24/24 | 24/24 |
| [MSK](https://overcast.sh/compat/msk/index.md) | 89.4% | no test | no test | no test | 34/38 | — | no test | no test | no test |
| [OpenSearch](https://overcast.sh/compat/opensearch/index.md) | 100% | no test | no test | no test | 14/14 | — | no test | no test | no test |
| [Organizations](https://overcast.sh/compat/organizations/index.md) | 45% | 18/40 | 18/40 | 18/40 | 18/40 | — | 18/40 | 18/40 | 18/40 |
| [Pipes](https://overcast.sh/compat/pipes/index.md) | 100% | 7/7 | 7/7 | 7/7 | 7/7 | — | 7/7 | no test | no test |
| [RDS](https://overcast.sh/compat/rds/index.md) | 100% | 25/25 | 25/25 | 25/25 | 25/25 | — | 25/25 | no test | no test |
| [S3](https://overcast.sh/compat/s3/index.md) | 100% | 33/33 | 33/33 | 33/33 | 33/33 | — | 33/33 | 33/33 | 33/33 |
| [S3 Tables](https://overcast.sh/compat/s3tables/index.md) | 100% | no test | 13/13 | 13/13 | 13/13 | — | no test | no test | no test |
| [Secrets Manager](https://overcast.sh/compat/secretsmanager/index.md) | 100% | 40/40 | 40/40 | 40/40 | 40/40 | — | 40/40 | 40/40 | 39/39 |
| [SES](https://overcast.sh/compat/ses/index.md) | 100% | 17/17 | 17/17 | 17/17 | 17/17 | — | 17/17 | no test | no test |
| [Shield](https://overcast.sh/compat/shield/index.md) | 100% | 5/5 | 5/5 | 5/5 | 5/5 | — | 5/5 | no test | no test |
| [SNS](https://overcast.sh/compat/sns/index.md) | 73.1% | 30/41 | 30/41 | 30/41 | 30/41 | — | 30/41 | 30/41 | 30/41 |
| [SQS](https://overcast.sh/compat/sqs/index.md) | 97.6% | 42/43 | 42/43 | 42/43 | 42/43 | — | 42/43 | 42/43 | 42/43 |
| [SSM](https://overcast.sh/compat/ssm/index.md) | 100% | 16/16 | 16/16 | 16/16 | 16/16 | — | 16/16 | 16/16 | 16/16 |
| [Step Functions](https://overcast.sh/compat/stepfunctions/index.md) | 100% | 10/10 | 10/10 | 10/10 | 10/10 | — | 10/10 | no test | no test |
| [STS](https://overcast.sh/compat/sts/index.md) | 100% | 5/5 | 5/5 | 5/5 | 5/5 | — | 5/5 | 5/5 | 5/5 |
| [WAF v2](https://overcast.sh/compat/waf/index.md) | 100% | 4/4 | 4/4 | 4/4 | 4/4 | — | 4/4 | no test | no test |