Secrets Manager
40 tests across 7 clients. Of the 279 results that measure Overcast, 279 pass (100%).
- JS 40/40 passing in AWS SDK for JavaScript v3
- Python 40/40 passing in AWS SDK for Python (boto3)
- Go 40/40 passing in AWS SDK for Go v2
- CLI 40/40 passing in AWS CLI v2
- Java 40/40 passing in AWS SDK for Java 2.x
- .NET 40/40 passing in AWS SDK for .NET
- Rust 39/39 passing in AWS SDK for Rust
40 tests
secretsmanager-crud
| Test | JS | Python | Go | CLI | Java | .NET | Rust |
|---|---|---|---|---|---|---|---|
| CreateSecret | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| GetSecretValue | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| DescribeSecret | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| PutSecretValue | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| ListSecretVersionIds | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| UpdateSecret | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| TagResource | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| UntagResource | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| GetRandomPassword | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| BatchGetSecretValue | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| ListSecrets | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| DeleteSecret | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
secretsmanager-rotate
| Test | JS | Python | Go | CLI | Java | .NET | Rust |
|---|---|---|---|---|---|---|---|
| RotateSecretWithoutLambda RotateSecret | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| RotateSecret | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| PutSecretValuePending PutSecretValue | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| GetSecretValueByStage GetSecretValue | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| UpdateSecretVersionStage | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| CancelRotateSecret | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
secretsmanager-policy
| Test | JS | Python | Go | CLI | Java | .NET | Rust |
|---|---|---|---|---|---|---|---|
| ValidateResourcePolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| PutResourcePolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| GetResourcePolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| DeleteResourcePolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
secretsmanager-gen-secret generated from the AWS model soaking
| Test | JS | Python | Go | CLI | Java | .NET | Rust |
|---|---|---|---|---|---|---|---|
| CreateSecret | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| DescribeSecret | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| UpdateSecret | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| TagResource | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| UntagResource | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: New test, still soaking |
Why 1 result does not passA test generated from the AWS model that has not yet run cleanly enough times to count.
Message eventually gave up after 10 attempt(s) 1000ms apart; last failure: secretsmanager-gen-secret/UntagResource: DescribeSecret params {"SecretId":"arn:aws:secretsmanager:us-east-1:000000000000:secret:oc-8f8b66e6-rs-secretsmanager-gen-secret-s-FQSB8s"}: absent at $.Tags: expected a list, actual null (compat/model/scenarios/secretsmanager.json assert[0].assert)
| |||||||
| GetRandomPassword | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| BatchGetSecretValue | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| ValidateResourcePolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| PutResourcePolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| GetResourcePolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| DeleteResourcePolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| CancelRotateSecret | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| ListSecrets | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| DeleteSecret | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
secretsmanager-gen-version generated from the AWS model
| Test | JS | Python | Go | CLI | Java | .NET | Rust |
|---|---|---|---|---|---|---|---|
| PutSecretValue | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| GetSecretValue | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| UpdateSecretVersionStage | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| ListSecretVersionIds | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
No test matches these filters.
Not tested (5)
Operations with no test at all. The test generator declined to write one, for the reason given.
| Operation | Reason | Detail |
|---|---|---|
| RemoveRegionsFromReplication | never-probe | Deletes a secret's replicas in other Regions. AWS deletes a replica immediately — there is no recovery window for one — so the secret value stops being readable in that Region the moment the call lands, and nothing in a probe group puts it back. |
| ReplicateSecretToRegions | never-probe | Creates a copy of the secret in other Regions. Each replica is a separate billed secret that outlives the run, and ForceOverwriteReplicaSecret will overwrite a secret somebody already keeps under that name in the destination Region. |
| RestoreSecret | probe-of-implemented-op | RestoreSecret is implemented (Supported), so it may not be probed, and no recipe resource gives it a role |
| RotateSecret | probe-of-implemented-op | RotateSecret is implemented (Supported), so it may not be probed, and no recipe resource gives it a role |
| StopReplicationToReplica | never-probe | Promotes a replica to a standalone secret and breaks its link to the primary. The split is not reversible — the two secrets diverge from that call onwards — and it is run against the replica, which is somebody's live secret. |