IAM
159 tests across 7 clients. Of the 1053 results that measure Overcast, 780 pass (74%).
- JS 118/157 passing in AWS SDK for JavaScript v3
- Python 118/157 passing in AWS SDK for Python (boto3)
- Go 118/157 passing in AWS SDK for Go v2
- CLI 118/157 passing in AWS CLI v2
- Java 118/157 passing in AWS SDK for Java 2.x
- .NET 118/157 passing in AWS SDK for .NET
- Rust 72/111 passing in AWS SDK for Rust
159 tests
iam-users
| Test | JS | Python | Go | CLI | Java | .NET | Rust |
|---|---|---|---|---|---|---|---|
| CreateUser | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
| GetUser | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
| ListUsers | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
| CreateAccessKey | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
| DeleteAccessKey | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
| PutUserPolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
| GetUserPolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
| DeleteUserPolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
| UpdateUser | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
| ListAccessKeys | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
| DeleteUser | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
iam-roles
| Test | JS | Python | Go | CLI | Java | .NET | Rust |
|---|---|---|---|---|---|---|---|
| CreateRole | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
| CreateRoleMalformedDocument CreateRole | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
| GetRole | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
| GetRoleReturnsTags GetRole | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
| ListRoles | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
| AttachRolePolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
| ListAttachedRolePolicies | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
| DetachRolePolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
| CreateInstanceProfile | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
| AddRoleToInstanceProfile | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
| GetInstanceProfile | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
| DeleteRole | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
| PutRolePolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
| GetRolePolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
| ListRolePolicies | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
| DeleteRolePolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
iam-policies
| Test | JS | Python | Go | CLI | Java | .NET | Rust |
|---|---|---|---|---|---|---|---|
| CreatePolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
| CreatePolicyMalformedDocument CreatePolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
| GetPolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
| GetPolicyReturnsTags GetPolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
| ListPolicies | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
| GetPolicyAttachmentCountAfterAttach GetPolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
| GetPolicyAttachmentCountAfterDetach GetPolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
| DeletePolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
iam-groups
| Test | JS | Python | Go | CLI | Java | .NET | Rust |
|---|---|---|---|---|---|---|---|
| CreateGroup | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
| AddUserToGroup | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
| ListGroupsForUser | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
| RemoveUserFromGroup | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
| GetGroup | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
| DeleteGroup | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
iam-simulate
| Test | JS | Python | Go | CLI | Java | .NET | Rust |
|---|---|---|---|---|---|---|---|
| SimulateCustomPolicyAllowed SimulateCustomPolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
| SimulateCustomPolicyImplicitDeny SimulateCustomPolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
| SimulateCustomPolicyExplicitDeny SimulateCustomPolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
| SimulatePrincipalPolicyAllowed SimulatePrincipalPolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
| SimulatePrincipalPolicyImplicitDeny SimulatePrincipalPolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: Test not written for this SDK |
Why 1 result does not pass AWS SDK for Rust: Test not written for this SDK AWS SDK for Rust Overcast may well support this; the test has not been written in this language yet. | |||||||
iam-gen-group generated from the AWS model
| Test | JS | Python | Go | CLI | Java | .NET | Rust |
|---|---|---|---|---|---|---|---|
| CreateGroup | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| GetGroup | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| AddUserToGroup | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| GetGroupMembers GetGroup | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| ListGroupsForUser | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| PutGroupPolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| GetGroupPolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| ListGroupPolicies | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| DeleteGroupPolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| AttachGroupPolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| ListAttachedGroupPolicies | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| DetachGroupPolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| RemoveUserFromGroup | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| ListGroups | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| DeleteGroup | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
iam-gen-instanceprofile generated from the AWS model
| Test | JS | Python | Go | CLI | Java | .NET | Rust |
|---|---|---|---|---|---|---|---|
| CreateInstanceProfile | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| GetInstanceProfile | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| TagInstanceProfile | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| ListInstanceProfileTags | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| UntagInstanceProfile | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| AddRoleToInstanceProfile | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| ListInstanceProfilesForRole | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| RemoveRoleFromInstanceProfile | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| ListInstanceProfiles | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| DeleteInstanceProfile | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
iam-gen-policy generated from the AWS model
| Test | JS | Python | Go | CLI | Java | .NET | Rust |
|---|---|---|---|---|---|---|---|
| CreatePolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| GetPolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| TagPolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| ListPolicyTags | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| UntagPolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| CreatePolicyVersion | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| DeletePolicyVersion | AWS SDK for JavaScript v3: Not emulated yet | AWS SDK for Python (boto3): Not emulated yet | AWS SDK for Go v2: Not emulated yet | AWS CLI v2: Not emulated yet | AWS SDK for Java 2.x: Not emulated yet | AWS SDK for .NET: Not emulated yet | AWS SDK for Rust: Not emulated yet |
Why 7 results do not pass · 7 on Overcast AWS SDK for JavaScript v3, AWS SDK for Python (boto3), AWS SDK for Go v2, AWS CLI v2, AWS SDK for Java 2.x, AWS SDK for .NET, AWS SDK for Rust: Not emulated yet JS, Python, Go, CLI, Java, .NET, Rust
Report this
Overcast returned 501 Not Implemented: the operation has no emulation yet. Messages (6)AWS SDK for JavaScript v3 NotImplemented: iam-gen-policy/DeletePolicyVersion: DeletePolicyVersion params={"PolicyArn":"arn:aws:iam::000000000000:policy/oc-207c52a7-nj-iam-gen-policy-p","VersionId":"v1"} — call: expected the call to succeed, actual NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix. (compat/model/scenarios/iam.json call)
AWS SDK for Python (boto3) An error occurred (NotImplemented) when calling the DeletePolicyVersion operation: This operation is not yet emulated. Check docs/services/ for the support matrix.
AWS SDK for Go v2 iam-gen-policy/DeletePolicyVersion: DeletePolicyVersion params {"PolicyArn":"arn:aws:iam::000000000000:policy/oc-96df6583-go-iam-gen-policy-p","VersionId":"v1"}: call: expected the call to succeed, actual "operation error IAM: DeletePolicyVersion, https response error StatusCode: 501, RequestID: 7e49c110-8e07-4f41-a8ce-3f7db256de35, api error NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Java 2.x iam-gen-policy/DeletePolicyVersion: DeletePolicyVersion params {"PolicyArn":"arn:aws:iam::000000000000:policy/oc-cbe847d6-jv-iam-gen-policy-p","VersionId":"v1"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix. (Service: Iam, Status Code: 501, Request ID: 87b8acbc-36b6-4fe5-94ed-b655c3225988) (SDK Attempt Count: 1)" (compat/model/scenarios/iam.json call)
AWS SDK for .NET iam-gen-policy/DeletePolicyVersion: DeletePolicyVersion params {"PolicyArn":"arn:aws:iam::000000000000:policy/oc-45ab451a-dn-iam-gen-policy-p","VersionId":"v1"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Rust iam-gen-policy/DeletePolicyVersion: DeletePolicyVersion params {"PolicyArn":"arn:aws:iam::000000000000:policy/oc-8f8b66e6-rs-iam-gen-policy-p","VersionId":"v1"}: call: expected the call to succeed, actual "service error: unhandled error (NotImplemented): Error { code: \"NotImplemented\", message: \"This operation is not yet emulated. Check docs/services/ for the support matrix.\", aws_request_id: \"fd1d4d6e-74af-44bf-a7f4-511c92675a89\" } (ServiceError(ServiceError { source: Unhandled(Unhandled { source: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"fd1d4d6e-74af-44bf-a7f4-511c92675a89\"}) }, meta: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"fd1d4d6e-74af-44bf-a7f4-511c92675a89\"}) } }), raw: Response { status: StatusCode(501), headers: {\"access-control-allow-headers\": \"Content-Type, Authorization\", \"access-control-allow-methods\": \"GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS\", \"access-control-allow-origin\": \"*\", \"access-control-expose-headers\": \"ETag, X-Amz-*, X-*\", \"content-length\": \"289\", \"content-type\": \"text/xml\", \"x-amzn-requestid\": \"fd1d4d6e-74af-44bf-a7f4-511c92675a89\", \"x-emulator-unsupported\": \"true\", \"date\": \"Thu, 24 Sep 2026 08:16:42 GMT\"}, body: SdkBody { inner: Once(Some(b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?>\\n<ErrorResponse><Error><Type>Sender</Type><Code>NotImplemented</Code><Message>This operation is not yet emulated. Check docs/services/ for the support matrix.</Message></Error><RequestId>fd1d4d6e-74af-44bf-a7f4-511c92675a89</RequestId></ErrorResponse>\")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo, aws_runtime::service_clock_skew::ResponseClockSkew} } } }))" (compat/model/scenarios/iam.json call)
| |||||||
| SimulateCustomPolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| ListPolicies | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| DeletePolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
iam-gen-probe generated from the AWS model
| Test | JS | Python | Go | CLI | Java | .NET | Rust |
|---|---|---|---|---|---|---|---|
| GetAccessKeyLastUsed | AWS SDK for JavaScript v3: Not emulated yet | AWS SDK for Python (boto3): Not emulated yet | AWS SDK for Go v2: Not emulated yet | AWS CLI v2: Not emulated yet | AWS SDK for Java 2.x: Not emulated yet | AWS SDK for .NET: Not emulated yet | AWS SDK for Rust: Not emulated yet |
Why 7 results do not pass · 7 on Overcast AWS SDK for JavaScript v3, AWS SDK for Python (boto3), AWS SDK for Go v2, AWS CLI v2, AWS SDK for Java 2.x, AWS SDK for .NET, AWS SDK for Rust: Not emulated yet JS, Python, Go, CLI, Java, .NET, Rust
Report this
Overcast returned 501 Not Implemented: the operation has no emulation yet. Messages (6)AWS SDK for JavaScript v3 NotImplemented: iam-gen-probe/GetAccessKeyLastUsed: GetAccessKeyLastUsed params={"AccessKeyId":"AKIAIOSFODNN7EXAMPLE"} — call: expected the call to succeed, actual NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix. (compat/model/scenarios/iam.json call)
AWS SDK for Python (boto3) An error occurred (NotImplemented) when calling the GetAccessKeyLastUsed operation: This operation is not yet emulated. Check docs/services/ for the support matrix.
AWS SDK for Go v2 iam-gen-probe/GetAccessKeyLastUsed: GetAccessKeyLastUsed params {"AccessKeyId":"AKIAIOSFODNN7EXAMPLE"}: call: expected the call to succeed, actual "operation error IAM: GetAccessKeyLastUsed, https response error StatusCode: 501, RequestID: ccf20ad7-25b3-4c58-ba92-793223364425, api error NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Java 2.x iam-gen-probe/GetAccessKeyLastUsed: GetAccessKeyLastUsed params {"AccessKeyId":"AKIAIOSFODNN7EXAMPLE"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix. (Service: Iam, Status Code: 501, Request ID: e1cb7977-a29d-44c0-a466-3c0c198105a8) (SDK Attempt Count: 1)" (compat/model/scenarios/iam.json call)
AWS SDK for .NET iam-gen-probe/GetAccessKeyLastUsed: GetAccessKeyLastUsed params {"AccessKeyId":"AKIAIOSFODNN7EXAMPLE"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Rust iam-gen-probe/GetAccessKeyLastUsed: GetAccessKeyLastUsed params {"AccessKeyId":"AKIAIOSFODNN7EXAMPLE"}: call: expected the call to succeed, actual "service error: unhandled error (NotImplemented): Error { code: \"NotImplemented\", message: \"This operation is not yet emulated. Check docs/services/ for the support matrix.\", aws_request_id: \"24cafb37-c739-4db0-80bf-77eaacc6b724\" } (ServiceError(ServiceError { source: Unhandled(Unhandled { source: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"24cafb37-c739-4db0-80bf-77eaacc6b724\"}) }, meta: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"24cafb37-c739-4db0-80bf-77eaacc6b724\"}) } }), raw: Response { status: StatusCode(501), headers: {\"access-control-allow-headers\": \"Content-Type, Authorization\", \"access-control-allow-methods\": \"GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS\", \"access-control-allow-origin\": \"*\", \"access-control-expose-headers\": \"ETag, X-Amz-*, X-*\", \"content-length\": \"289\", \"content-type\": \"text/xml\", \"x-amzn-requestid\": \"24cafb37-c739-4db0-80bf-77eaacc6b724\", \"x-emulator-unsupported\": \"true\", \"date\": \"Thu, 24 Sep 2026 08:16:42 GMT\"}, body: SdkBody { inner: Once(Some(b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?>\\n<ErrorResponse><Error><Type>Sender</Type><Code>NotImplemented</Code><Message>This operation is not yet emulated. Check docs/services/ for the support matrix.</Message></Error><RequestId>24cafb37-c739-4db0-80bf-77eaacc6b724</RequestId></ErrorResponse>\")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo, aws_runtime::service_clock_skew::ResponseClockSkew} } } }))" (compat/model/scenarios/iam.json call)
| |||||||
| GetAccountPasswordPolicy | AWS SDK for JavaScript v3: Not emulated yet | AWS SDK for Python (boto3): Not emulated yet | AWS SDK for Go v2: Not emulated yet | AWS CLI v2: Not emulated yet | AWS SDK for Java 2.x: Not emulated yet | AWS SDK for .NET: Not emulated yet | AWS SDK for Rust: Not emulated yet |
Why 7 results do not pass · 7 on Overcast AWS SDK for JavaScript v3, AWS SDK for Python (boto3), AWS SDK for Go v2, AWS CLI v2, AWS SDK for Java 2.x, AWS SDK for .NET, AWS SDK for Rust: Not emulated yet JS, Python, Go, CLI, Java, .NET, Rust
Report this
Overcast returned 501 Not Implemented: the operation has no emulation yet. Messages (6)AWS SDK for JavaScript v3 NotImplemented: iam-gen-probe/GetAccountPasswordPolicy: GetAccountPasswordPolicy params={} — call: expected the call to succeed, actual NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix. (compat/model/scenarios/iam.json call)
AWS SDK for Python (boto3) An error occurred (NotImplemented) when calling the GetAccountPasswordPolicy operation: This operation is not yet emulated. Check docs/services/ for the support matrix.
AWS SDK for Go v2 iam-gen-probe/GetAccountPasswordPolicy: GetAccountPasswordPolicy params {}: call: expected the call to succeed, actual "operation error IAM: GetAccountPasswordPolicy, https response error StatusCode: 501, RequestID: 02110035-5cfd-44f2-93a8-121785cfb45b, api error NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Java 2.x iam-gen-probe/GetAccountPasswordPolicy: GetAccountPasswordPolicy params {}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix. (Service: Iam, Status Code: 501, Request ID: 4a2196d0-8d31-4518-8d0b-57a3c8f390e8) (SDK Attempt Count: 1)" (compat/model/scenarios/iam.json call)
AWS SDK for .NET iam-gen-probe/GetAccountPasswordPolicy: GetAccountPasswordPolicy params {}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Rust iam-gen-probe/GetAccountPasswordPolicy: GetAccountPasswordPolicy params {}: call: expected the call to succeed, actual "service error: unhandled error (NotImplemented): Error { code: \"NotImplemented\", message: \"This operation is not yet emulated. Check docs/services/ for the support matrix.\", aws_request_id: \"9ec42db4-6518-4349-acb0-27d8adfb3440\" } (ServiceError(ServiceError { source: Unhandled(Unhandled { source: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"9ec42db4-6518-4349-acb0-27d8adfb3440\"}) }, meta: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"9ec42db4-6518-4349-acb0-27d8adfb3440\"}) } }), raw: Response { status: StatusCode(501), headers: {\"access-control-allow-headers\": \"Content-Type, Authorization\", \"access-control-allow-methods\": \"GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS\", \"access-control-allow-origin\": \"*\", \"access-control-expose-headers\": \"ETag, X-Amz-*, X-*\", \"content-length\": \"289\", \"content-type\": \"text/xml\", \"x-amzn-requestid\": \"9ec42db4-6518-4349-acb0-27d8adfb3440\", \"x-emulator-unsupported\": \"true\", \"date\": \"Thu, 24 Sep 2026 08:16:42 GMT\"}, body: SdkBody { inner: Once(Some(b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?>\\n<ErrorResponse><Error><Type>Sender</Type><Code>NotImplemented</Code><Message>This operation is not yet emulated. Check docs/services/ for the support matrix.</Message></Error><RequestId>9ec42db4-6518-4349-acb0-27d8adfb3440</RequestId></ErrorResponse>\")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo, aws_runtime::service_clock_skew::ResponseClockSkew} } } }))" (compat/model/scenarios/iam.json call)
| |||||||
| GetAccountSummary | AWS SDK for JavaScript v3: Not emulated yet | AWS SDK for Python (boto3): Not emulated yet | AWS SDK for Go v2: Not emulated yet | AWS CLI v2: Not emulated yet | AWS SDK for Java 2.x: Not emulated yet | AWS SDK for .NET: Not emulated yet | AWS SDK for Rust: Not emulated yet |
Why 7 results do not pass · 7 on Overcast AWS SDK for JavaScript v3, AWS SDK for Python (boto3), AWS SDK for Go v2, AWS CLI v2, AWS SDK for Java 2.x, AWS SDK for .NET, AWS SDK for Rust: Not emulated yet JS, Python, Go, CLI, Java, .NET, Rust
Report this
Overcast returned 501 Not Implemented: the operation has no emulation yet. Messages (6)AWS SDK for JavaScript v3 NotImplemented: iam-gen-probe/GetAccountSummary: GetAccountSummary params={} — call: expected the call to succeed, actual NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix. (compat/model/scenarios/iam.json call)
AWS SDK for Python (boto3) An error occurred (NotImplemented) when calling the GetAccountSummary operation: This operation is not yet emulated. Check docs/services/ for the support matrix.
AWS SDK for Go v2 iam-gen-probe/GetAccountSummary: GetAccountSummary params {}: call: expected the call to succeed, actual "operation error IAM: GetAccountSummary, https response error StatusCode: 501, RequestID: f7d6cdca-a306-4ae8-b48b-c31fb8ebb5ef, api error NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Java 2.x iam-gen-probe/GetAccountSummary: GetAccountSummary params {}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix. (Service: Iam, Status Code: 501, Request ID: d37b3fc5-9d09-4f8c-838b-8c3b43cf7254) (SDK Attempt Count: 1)" (compat/model/scenarios/iam.json call)
AWS SDK for .NET iam-gen-probe/GetAccountSummary: GetAccountSummary params {}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Rust iam-gen-probe/GetAccountSummary: GetAccountSummary params {}: call: expected the call to succeed, actual "service error: unhandled error (NotImplemented): Error { code: \"NotImplemented\", message: \"This operation is not yet emulated. Check docs/services/ for the support matrix.\", aws_request_id: \"a5c7408c-bd3a-48ae-ab58-31a006ce1b56\" } (ServiceError(ServiceError { source: Unhandled(Unhandled { source: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"a5c7408c-bd3a-48ae-ab58-31a006ce1b56\"}) }, meta: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"a5c7408c-bd3a-48ae-ab58-31a006ce1b56\"}) } }), raw: Response { status: StatusCode(501), headers: {\"access-control-allow-headers\": \"Content-Type, Authorization\", \"access-control-allow-methods\": \"GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS\", \"access-control-allow-origin\": \"*\", \"access-control-expose-headers\": \"ETag, X-Amz-*, X-*\", \"content-length\": \"289\", \"content-type\": \"text/xml\", \"x-amzn-requestid\": \"a5c7408c-bd3a-48ae-ab58-31a006ce1b56\", \"x-emulator-unsupported\": \"true\", \"date\": \"Thu, 24 Sep 2026 08:16:42 GMT\"}, body: SdkBody { inner: Once(Some(b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?>\\n<ErrorResponse><Error><Type>Sender</Type><Code>NotImplemented</Code><Message>This operation is not yet emulated. Check docs/services/ for the support matrix.</Message></Error><RequestId>a5c7408c-bd3a-48ae-ab58-31a006ce1b56</RequestId></ErrorResponse>\")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo, aws_runtime::service_clock_skew::ResponseClockSkew} } } }))" (compat/model/scenarios/iam.json call)
| |||||||
| GetContextKeysForCustomPolicy | AWS SDK for JavaScript v3: Not emulated yet | AWS SDK for Python (boto3): Not emulated yet | AWS SDK for Go v2: Not emulated yet | AWS CLI v2: Not emulated yet | AWS SDK for Java 2.x: Not emulated yet | AWS SDK for .NET: Not emulated yet | AWS SDK for Rust: Not emulated yet |
Why 7 results do not pass · 7 on Overcast AWS SDK for JavaScript v3, AWS SDK for Python (boto3), AWS SDK for Go v2, AWS CLI v2, AWS SDK for Java 2.x, AWS SDK for .NET, AWS SDK for Rust: Not emulated yet JS, Python, Go, CLI, Java, .NET, Rust
Report this
Overcast returned 501 Not Implemented: the operation has no emulation yet. Messages (6)AWS SDK for JavaScript v3 NotImplemented: iam-gen-probe/GetContextKeysForCustomPolicy: GetContextKeysForCustomPolicy params={"PolicyInputList":["{\"Version\":\"2012-10-17\",\"Statement\":[{\"Effect\":\"Allow\",\"Action\":\"s3:GetObject\",\"Resource\":\"arn:aws:s3:::compat-scenario-nonexistent/*\"}]}"]} — call: expected the call to succeed, actual NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix. (compat/model/scenarios/iam.json call)
AWS SDK for Python (boto3) An error occurred (NotImplemented) when calling the GetContextKeysForCustomPolicy operation: This operation is not yet emulated. Check docs/services/ for the support matrix.
AWS SDK for Go v2 iam-gen-probe/GetContextKeysForCustomPolicy: GetContextKeysForCustomPolicy params {"PolicyInputList":["{\"Version\":\"2012-10-17\",\"Statement\":[{\"Effect\":\"Allow\",\"Action\":\"s3:GetObject\",\"Resource\":\"arn:aws:s3:::compat-scenario-nonexistent/*\"}]}"]}: call: expected the call to succeed, actual "operation error IAM: GetContextKeysForCustomPolicy, https response error StatusCode: 501, RequestID: 3449f6f2-751e-46f4-b1ef-0b2e2b64ec1c, api error NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Java 2.x iam-gen-probe/GetContextKeysForCustomPolicy: GetContextKeysForCustomPolicy params {"PolicyInputList":["{\"Version\":\"2012-10-17\",\"Statement\":[{\"Effect\":\"Allow\",\"Action\":\"s3:GetObject\",\"Resource\":\"arn:aws:s3:::compat-scenario-nonexistent/*\"}]}"]}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix. (Service: Iam, Status Code: 501, Request ID: e91b5e9a-2485-4ece-b919-a9baa45fa3fd) (SDK Attempt Count: 1)" (compat/model/scenarios/iam.json call)
AWS SDK for .NET iam-gen-probe/GetContextKeysForCustomPolicy: GetContextKeysForCustomPolicy params {"PolicyInputList":["{\"Version\":\"2012-10-17\",\"Statement\":[{\"Effect\":\"Allow\",\"Action\":\"s3:GetObject\",\"Resource\":\"arn:aws:s3:::compat-scenario-nonexistent/*\"}]}"]}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Rust iam-gen-probe/GetContextKeysForCustomPolicy: GetContextKeysForCustomPolicy params {"PolicyInputList":["{\"Version\":\"2012-10-17\",\"Statement\":[{\"Effect\":\"Allow\",\"Action\":\"s3:GetObject\",\"Resource\":\"arn:aws:s3:::compat-scenario-nonexistent/*\"}]}"]}: call: expected the call to succeed, actual "service error: unhandled error (NotImplemented): Error { code: \"NotImplemented\", message: \"This operation is not yet emulated. Check docs/services/ for the support matrix.\", aws_request_id: \"8d4abbc7-3558-4ad9-860d-69af6fe04238\" } (ServiceError(ServiceError { source: Unhandled(Unhandled { source: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"8d4abbc7-3558-4ad9-860d-69af6fe04238\"}) }, meta: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"8d4abbc7-3558-4ad9-860d-69af6fe04238\"}) } }), raw: Response { status: StatusCode(501), headers: {\"access-control-allow-headers\": \"Content-Type, Authorization\", \"access-control-allow-methods\": \"GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS\", \"access-control-allow-origin\": \"*\", \"access-control-expose-headers\": \"ETag, X-Amz-*, X-*\", \"content-length\": \"289\", \"content-type\": \"text/xml\", \"x-amzn-requestid\": \"8d4abbc7-3558-4ad9-860d-69af6fe04238\", \"x-emulator-unsupported\": \"true\", \"date\": \"Thu, 24 Sep 2026 08:16:42 GMT\"}, body: SdkBody { inner: Once(Some(b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?>\\n<ErrorResponse><Error><Type>Sender</Type><Code>NotImplemented</Code><Message>This operation is not yet emulated. Check docs/services/ for the support matrix.</Message></Error><RequestId>8d4abbc7-3558-4ad9-860d-69af6fe04238</RequestId></ErrorResponse>\")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo, aws_runtime::service_clock_skew::ResponseClockSkew} } } }))" (compat/model/scenarios/iam.json call)
| |||||||
| GetContextKeysForPrincipalPolicy | AWS SDK for JavaScript v3: Not emulated yet | AWS SDK for Python (boto3): Not emulated yet | AWS SDK for Go v2: Not emulated yet | AWS CLI v2: Not emulated yet | AWS SDK for Java 2.x: Not emulated yet | AWS SDK for .NET: Not emulated yet | AWS SDK for Rust: Not emulated yet |
Why 7 results do not pass · 7 on Overcast AWS SDK for JavaScript v3, AWS SDK for Python (boto3), AWS SDK for Go v2, AWS CLI v2, AWS SDK for Java 2.x, AWS SDK for .NET, AWS SDK for Rust: Not emulated yet JS, Python, Go, CLI, Java, .NET, Rust
Report this
Overcast returned 501 Not Implemented: the operation has no emulation yet. Messages (6)AWS SDK for JavaScript v3 NotImplemented: iam-gen-probe/GetContextKeysForPrincipalPolicy: GetContextKeysForPrincipalPolicy params={"PolicySourceArn":"arn:aws:iam::123456789012:user/compat-scenario-nonexistent"} — call: expected the call to succeed, actual NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix. (compat/model/scenarios/iam.json call)
AWS SDK for Python (boto3) An error occurred (NotImplemented) when calling the GetContextKeysForPrincipalPolicy operation: This operation is not yet emulated. Check docs/services/ for the support matrix.
AWS SDK for Go v2 iam-gen-probe/GetContextKeysForPrincipalPolicy: GetContextKeysForPrincipalPolicy params {"PolicySourceArn":"arn:aws:iam::123456789012:user/compat-scenario-nonexistent"}: call: expected the call to succeed, actual "operation error IAM: GetContextKeysForPrincipalPolicy, https response error StatusCode: 501, RequestID: 799a7822-ffb5-471b-8483-9e9f9f8c4e56, api error NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Java 2.x iam-gen-probe/GetContextKeysForPrincipalPolicy: GetContextKeysForPrincipalPolicy params {"PolicySourceArn":"arn:aws:iam::123456789012:user/compat-scenario-nonexistent"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix. (Service: Iam, Status Code: 501, Request ID: f8456ef7-395e-4bd9-9a3c-62487dbf8c5f) (SDK Attempt Count: 1)" (compat/model/scenarios/iam.json call)
AWS SDK for .NET iam-gen-probe/GetContextKeysForPrincipalPolicy: GetContextKeysForPrincipalPolicy params {"PolicySourceArn":"arn:aws:iam::123456789012:user/compat-scenario-nonexistent"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Rust iam-gen-probe/GetContextKeysForPrincipalPolicy: GetContextKeysForPrincipalPolicy params {"PolicySourceArn":"arn:aws:iam::123456789012:user/compat-scenario-nonexistent"}: call: expected the call to succeed, actual "service error: unhandled error (NotImplemented): Error { code: \"NotImplemented\", message: \"This operation is not yet emulated. Check docs/services/ for the support matrix.\", aws_request_id: \"22ef471b-d3ff-4c59-acdc-7989ed84c602\" } (ServiceError(ServiceError { source: Unhandled(Unhandled { source: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"22ef471b-d3ff-4c59-acdc-7989ed84c602\"}) }, meta: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"22ef471b-d3ff-4c59-acdc-7989ed84c602\"}) } }), raw: Response { status: StatusCode(501), headers: {\"access-control-allow-headers\": \"Content-Type, Authorization\", \"access-control-allow-methods\": \"GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS\", \"access-control-allow-origin\": \"*\", \"access-control-expose-headers\": \"ETag, X-Amz-*, X-*\", \"content-length\": \"289\", \"content-type\": \"text/xml\", \"x-amzn-requestid\": \"22ef471b-d3ff-4c59-acdc-7989ed84c602\", \"x-emulator-unsupported\": \"true\", \"date\": \"Thu, 24 Sep 2026 08:16:42 GMT\"}, body: SdkBody { inner: Once(Some(b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?>\\n<ErrorResponse><Error><Type>Sender</Type><Code>NotImplemented</Code><Message>This operation is not yet emulated. Check docs/services/ for the support matrix.</Message></Error><RequestId>22ef471b-d3ff-4c59-acdc-7989ed84c602</RequestId></ErrorResponse>\")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo, aws_runtime::service_clock_skew::ResponseClockSkew} } } }))" (compat/model/scenarios/iam.json call)
| |||||||
| GetCredentialReport | AWS SDK for JavaScript v3: Not emulated yet | AWS SDK for Python (boto3): Not emulated yet | AWS SDK for Go v2: Not emulated yet | AWS CLI v2: Not emulated yet | AWS SDK for Java 2.x: Not emulated yet | AWS SDK for .NET: Not emulated yet | AWS SDK for Rust: Not emulated yet |
Why 7 results do not pass · 7 on Overcast AWS SDK for JavaScript v3, AWS SDK for Python (boto3), AWS SDK for Go v2, AWS CLI v2, AWS SDK for Java 2.x, AWS SDK for .NET, AWS SDK for Rust: Not emulated yet JS, Python, Go, CLI, Java, .NET, Rust
Report this
Overcast returned 501 Not Implemented: the operation has no emulation yet. Messages (6)AWS SDK for JavaScript v3 NotImplemented: iam-gen-probe/GetCredentialReport: GetCredentialReport params={} — call: expected the call to succeed, actual NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix. (compat/model/scenarios/iam.json call)
AWS SDK for Python (boto3) An error occurred (NotImplemented) when calling the GetCredentialReport operation: This operation is not yet emulated. Check docs/services/ for the support matrix.
AWS SDK for Go v2 iam-gen-probe/GetCredentialReport: GetCredentialReport params {}: call: expected the call to succeed, actual "operation error IAM: GetCredentialReport, https response error StatusCode: 501, RequestID: 3f5e41e7-6ec9-4c83-b35c-6a9e860581ab, api error NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Java 2.x iam-gen-probe/GetCredentialReport: GetCredentialReport params {}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix. (Service: Iam, Status Code: 501, Request ID: f681adf5-e5a8-4c7a-87fe-866f12892c43) (SDK Attempt Count: 1)" (compat/model/scenarios/iam.json call)
AWS SDK for .NET iam-gen-probe/GetCredentialReport: GetCredentialReport params {}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Rust iam-gen-probe/GetCredentialReport: GetCredentialReport params {}: call: expected the call to succeed, actual "service error: unhandled error (NotImplemented): Error { code: \"NotImplemented\", message: \"This operation is not yet emulated. Check docs/services/ for the support matrix.\", aws_request_id: \"2e6c7238-7ca1-410b-aefb-bf8a1dcb23c6\" } (ServiceError(ServiceError { source: Unhandled(Unhandled { source: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"2e6c7238-7ca1-410b-aefb-bf8a1dcb23c6\"}) }, meta: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"2e6c7238-7ca1-410b-aefb-bf8a1dcb23c6\"}) } }), raw: Response { status: StatusCode(501), headers: {\"access-control-allow-headers\": \"Content-Type, Authorization\", \"access-control-allow-methods\": \"GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS\", \"access-control-allow-origin\": \"*\", \"access-control-expose-headers\": \"ETag, X-Amz-*, X-*\", \"content-length\": \"289\", \"content-type\": \"text/xml\", \"x-amzn-requestid\": \"2e6c7238-7ca1-410b-aefb-bf8a1dcb23c6\", \"x-emulator-unsupported\": \"true\", \"date\": \"Thu, 24 Sep 2026 08:16:42 GMT\"}, body: SdkBody { inner: Once(Some(b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?>\\n<ErrorResponse><Error><Type>Sender</Type><Code>NotImplemented</Code><Message>This operation is not yet emulated. Check docs/services/ for the support matrix.</Message></Error><RequestId>2e6c7238-7ca1-410b-aefb-bf8a1dcb23c6</RequestId></ErrorResponse>\")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo, aws_runtime::service_clock_skew::ResponseClockSkew} } } }))" (compat/model/scenarios/iam.json call)
| |||||||
| GetDelegationRequest | AWS SDK for JavaScript v3: Not emulated yet | AWS SDK for Python (boto3): Not emulated yet | AWS SDK for Go v2: Not emulated yet | AWS CLI v2: Not emulated yet | AWS SDK for Java 2.x: Not emulated yet | AWS SDK for .NET: Not emulated yet | AWS SDK for Rust: Not emulated yet |
Why 7 results do not pass · 7 on Overcast AWS SDK for JavaScript v3, AWS SDK for Python (boto3), AWS SDK for Go v2, AWS CLI v2, AWS SDK for Java 2.x, AWS SDK for .NET, AWS SDK for Rust: Not emulated yet JS, Python, Go, CLI, Java, .NET, Rust
Report this
Overcast returned 501 Not Implemented: the operation has no emulation yet. Messages (6)AWS SDK for JavaScript v3 NotImplemented: iam-gen-probe/GetDelegationRequest: GetDelegationRequest params={"DelegationRequestId":"compat-scenario-nonexistent-delegation"} — call: expected the call to succeed, actual NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix. (compat/model/scenarios/iam.json call)
AWS SDK for Python (boto3) An error occurred (NotImplemented) when calling the GetDelegationRequest operation: This operation is not yet emulated. Check docs/services/ for the support matrix.
AWS SDK for Go v2 iam-gen-probe/GetDelegationRequest: GetDelegationRequest params {"DelegationPermissionCheck":false,"DelegationRequestId":"compat-scenario-nonexistent-delegation"}: call: expected the call to succeed, actual "operation error IAM: GetDelegationRequest, https response error StatusCode: 501, RequestID: ff4e2cfa-87ae-4db5-8d26-cd24aeb120b9, api error NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Java 2.x iam-gen-probe/GetDelegationRequest: GetDelegationRequest params {"DelegationRequestId":"compat-scenario-nonexistent-delegation"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix. (Service: Iam, Status Code: 501, Request ID: aafd5366-73c9-487a-a3e8-9a3efa5786c6) (SDK Attempt Count: 1)" (compat/model/scenarios/iam.json call)
AWS SDK for .NET iam-gen-probe/GetDelegationRequest: GetDelegationRequest params {"DelegationRequestId":"compat-scenario-nonexistent-delegation"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Rust iam-gen-probe/GetDelegationRequest: GetDelegationRequest params {"DelegationRequestId":"compat-scenario-nonexistent-delegation"}: call: expected the call to succeed, actual "service error: unhandled error (NotImplemented): Error { code: \"NotImplemented\", message: \"This operation is not yet emulated. Check docs/services/ for the support matrix.\", aws_request_id: \"34d27def-5274-4d4d-8b58-a24bb406b807\" } (ServiceError(ServiceError { source: Unhandled(Unhandled { source: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"34d27def-5274-4d4d-8b58-a24bb406b807\"}) }, meta: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"34d27def-5274-4d4d-8b58-a24bb406b807\"}) } }), raw: Response { status: StatusCode(501), headers: {\"access-control-allow-headers\": \"Content-Type, Authorization\", \"access-control-allow-methods\": \"GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS\", \"access-control-allow-origin\": \"*\", \"access-control-expose-headers\": \"ETag, X-Amz-*, X-*\", \"content-length\": \"289\", \"content-type\": \"text/xml\", \"x-amzn-requestid\": \"34d27def-5274-4d4d-8b58-a24bb406b807\", \"x-emulator-unsupported\": \"true\", \"date\": \"Thu, 24 Sep 2026 08:16:42 GMT\"}, body: SdkBody { inner: Once(Some(b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?>\\n<ErrorResponse><Error><Type>Sender</Type><Code>NotImplemented</Code><Message>This operation is not yet emulated. Check docs/services/ for the support matrix.</Message></Error><RequestId>34d27def-5274-4d4d-8b58-a24bb406b807</RequestId></ErrorResponse>\")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo, aws_runtime::service_clock_skew::ResponseClockSkew} } } }))" (compat/model/scenarios/iam.json call)
| |||||||
| GetHumanReadableSummary | AWS SDK for JavaScript v3: Not emulated yet | AWS SDK for Python (boto3): Not emulated yet | AWS SDK for Go v2: Not emulated yet | AWS CLI v2: Not emulated yet | AWS SDK for Java 2.x: Not emulated yet | AWS SDK for .NET: Not emulated yet | AWS SDK for Rust: Not emulated yet |
Why 7 results do not pass · 7 on Overcast AWS SDK for JavaScript v3, AWS SDK for Python (boto3), AWS SDK for Go v2, AWS CLI v2, AWS SDK for Java 2.x, AWS SDK for .NET, AWS SDK for Rust: Not emulated yet JS, Python, Go, CLI, Java, .NET, Rust
Report this
Overcast returned 501 Not Implemented: the operation has no emulation yet. Messages (6)AWS SDK for JavaScript v3 NotImplemented: iam-gen-probe/GetHumanReadableSummary: GetHumanReadableSummary params={"EntityArn":"arn:aws:iam::123456789012:role/compat-scenario-nonexistent"} — call: expected the call to succeed, actual NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix. (compat/model/scenarios/iam.json call)
AWS SDK for Python (boto3) An error occurred (NotImplemented) when calling the GetHumanReadableSummary operation: This operation is not yet emulated. Check docs/services/ for the support matrix.
AWS SDK for Go v2 iam-gen-probe/GetHumanReadableSummary: GetHumanReadableSummary params {"EntityArn":"arn:aws:iam::123456789012:role/compat-scenario-nonexistent"}: call: expected the call to succeed, actual "operation error IAM: GetHumanReadableSummary, https response error StatusCode: 501, RequestID: 21af2c3b-f9aa-427c-9f24-4e8d16cd536d, api error NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Java 2.x iam-gen-probe/GetHumanReadableSummary: GetHumanReadableSummary params {"EntityArn":"arn:aws:iam::123456789012:role/compat-scenario-nonexistent"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix. (Service: Iam, Status Code: 501, Request ID: d3bff7b7-47d2-4e5d-98d0-2f6c1608ee89) (SDK Attempt Count: 1)" (compat/model/scenarios/iam.json call)
AWS SDK for .NET iam-gen-probe/GetHumanReadableSummary: GetHumanReadableSummary params {"EntityArn":"arn:aws:iam::123456789012:role/compat-scenario-nonexistent"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Rust iam-gen-probe/GetHumanReadableSummary: GetHumanReadableSummary params {"EntityArn":"arn:aws:iam::123456789012:role/compat-scenario-nonexistent"}: call: expected the call to succeed, actual "service error: unhandled error (NotImplemented): Error { code: \"NotImplemented\", message: \"This operation is not yet emulated. Check docs/services/ for the support matrix.\", aws_request_id: \"f5aa60aa-98b3-4179-bf8a-187de5a330c4\" } (ServiceError(ServiceError { source: Unhandled(Unhandled { source: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"f5aa60aa-98b3-4179-bf8a-187de5a330c4\"}) }, meta: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"f5aa60aa-98b3-4179-bf8a-187de5a330c4\"}) } }), raw: Response { status: StatusCode(501), headers: {\"access-control-allow-headers\": \"Content-Type, Authorization\", \"access-control-allow-methods\": \"GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS\", \"access-control-allow-origin\": \"*\", \"access-control-expose-headers\": \"ETag, X-Amz-*, X-*\", \"content-length\": \"289\", \"content-type\": \"text/xml\", \"x-amzn-requestid\": \"f5aa60aa-98b3-4179-bf8a-187de5a330c4\", \"x-emulator-unsupported\": \"true\", \"date\": \"Thu, 24 Sep 2026 08:16:42 GMT\"}, body: SdkBody { inner: Once(Some(b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?>\\n<ErrorResponse><Error><Type>Sender</Type><Code>NotImplemented</Code><Message>This operation is not yet emulated. Check docs/services/ for the support matrix.</Message></Error><RequestId>f5aa60aa-98b3-4179-bf8a-187de5a330c4</RequestId></ErrorResponse>\")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo, aws_runtime::service_clock_skew::ResponseClockSkew} } } }))" (compat/model/scenarios/iam.json call)
| |||||||
| GetLoginProfile | AWS SDK for JavaScript v3: Not emulated yet | AWS SDK for Python (boto3): Not emulated yet | AWS SDK for Go v2: Not emulated yet | AWS CLI v2: Not emulated yet | AWS SDK for Java 2.x: Not emulated yet | AWS SDK for .NET: Not emulated yet | AWS SDK for Rust: Not emulated yet |
Why 7 results do not pass · 7 on Overcast AWS SDK for JavaScript v3, AWS SDK for Python (boto3), AWS SDK for Go v2, AWS CLI v2, AWS SDK for Java 2.x, AWS SDK for .NET, AWS SDK for Rust: Not emulated yet JS, Python, Go, CLI, Java, .NET, Rust
Report this
Overcast returned 501 Not Implemented: the operation has no emulation yet. Messages (6)AWS SDK for JavaScript v3 NotImplemented: iam-gen-probe/GetLoginProfile: GetLoginProfile params={} — call: expected the call to succeed, actual NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix. (compat/model/scenarios/iam.json call)
AWS SDK for Python (boto3) An error occurred (NotImplemented) when calling the GetLoginProfile operation: This operation is not yet emulated. Check docs/services/ for the support matrix.
AWS SDK for Go v2 iam-gen-probe/GetLoginProfile: GetLoginProfile params {}: call: expected the call to succeed, actual "operation error IAM: GetLoginProfile, https response error StatusCode: 501, RequestID: 87534c16-66fb-4a9a-9bf5-d0af6f59ba5b, api error NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Java 2.x iam-gen-probe/GetLoginProfile: GetLoginProfile params {}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix. (Service: Iam, Status Code: 501, Request ID: 1d349537-b3b0-470a-8c64-39adb43ff095) (SDK Attempt Count: 1)" (compat/model/scenarios/iam.json call)
AWS SDK for .NET iam-gen-probe/GetLoginProfile: GetLoginProfile params {}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Rust iam-gen-probe/GetLoginProfile: GetLoginProfile params {}: call: expected the call to succeed, actual "service error: unhandled error (NotImplemented): Error { code: \"NotImplemented\", message: \"This operation is not yet emulated. Check docs/services/ for the support matrix.\", aws_request_id: \"bad59da3-f420-46ba-92b0-8c15ea2efcde\" } (ServiceError(ServiceError { source: Unhandled(Unhandled { source: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"bad59da3-f420-46ba-92b0-8c15ea2efcde\"}) }, meta: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"bad59da3-f420-46ba-92b0-8c15ea2efcde\"}) } }), raw: Response { status: StatusCode(501), headers: {\"access-control-allow-headers\": \"Content-Type, Authorization\", \"access-control-allow-methods\": \"GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS\", \"access-control-allow-origin\": \"*\", \"access-control-expose-headers\": \"ETag, X-Amz-*, X-*\", \"content-length\": \"289\", \"content-type\": \"text/xml\", \"x-amzn-requestid\": \"bad59da3-f420-46ba-92b0-8c15ea2efcde\", \"x-emulator-unsupported\": \"true\", \"date\": \"Thu, 24 Sep 2026 08:16:42 GMT\"}, body: SdkBody { inner: Once(Some(b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?>\\n<ErrorResponse><Error><Type>Sender</Type><Code>NotImplemented</Code><Message>This operation is not yet emulated. Check docs/services/ for the support matrix.</Message></Error><RequestId>bad59da3-f420-46ba-92b0-8c15ea2efcde</RequestId></ErrorResponse>\")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo, aws_runtime::service_clock_skew::ResponseClockSkew} } } }))" (compat/model/scenarios/iam.json call)
| |||||||
| GetMFADevice | AWS SDK for JavaScript v3: Not emulated yet | AWS SDK for Python (boto3): Not emulated yet | AWS SDK for Go v2: Not emulated yet | AWS CLI v2: Not emulated yet | AWS SDK for Java 2.x: Not emulated yet | AWS SDK for .NET: Not emulated yet | AWS SDK for Rust: Not emulated yet |
Why 7 results do not pass · 7 on Overcast AWS SDK for JavaScript v3, AWS SDK for Python (boto3), AWS SDK for Go v2, AWS CLI v2, AWS SDK for Java 2.x, AWS SDK for .NET, AWS SDK for Rust: Not emulated yet JS, Python, Go, CLI, Java, .NET, Rust
Report this
Overcast returned 501 Not Implemented: the operation has no emulation yet. Messages (6)AWS SDK for JavaScript v3 NotImplemented: iam-gen-probe/GetMFADevice: GetMFADevice params={"SerialNumber":"arn:aws:iam::123456789012:mfa/compat-scenario-nonexistent"} — call: expected the call to succeed, actual NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix. (compat/model/scenarios/iam.json call)
AWS SDK for Python (boto3) An error occurred (NotImplemented) when calling the GetMFADevice operation: This operation is not yet emulated. Check docs/services/ for the support matrix.
AWS SDK for Go v2 iam-gen-probe/GetMFADevice: GetMFADevice params {"SerialNumber":"arn:aws:iam::123456789012:mfa/compat-scenario-nonexistent"}: call: expected the call to succeed, actual "operation error IAM: GetMFADevice, https response error StatusCode: 501, RequestID: f590515a-d794-4553-ab0a-765901fa2c2d, api error NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Java 2.x iam-gen-probe/GetMFADevice: GetMFADevice params {"SerialNumber":"arn:aws:iam::123456789012:mfa/compat-scenario-nonexistent"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix. (Service: Iam, Status Code: 501, Request ID: a642c53f-fca1-4ac2-b932-b0476b20c948) (SDK Attempt Count: 1)" (compat/model/scenarios/iam.json call)
AWS SDK for .NET iam-gen-probe/GetMFADevice: GetMFADevice params {"SerialNumber":"arn:aws:iam::123456789012:mfa/compat-scenario-nonexistent"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Rust iam-gen-probe/GetMFADevice: GetMFADevice params {"SerialNumber":"arn:aws:iam::123456789012:mfa/compat-scenario-nonexistent"}: call: expected the call to succeed, actual "service error: unhandled error (NotImplemented): Error { code: \"NotImplemented\", message: \"This operation is not yet emulated. Check docs/services/ for the support matrix.\", aws_request_id: \"9fc9947c-d497-4aee-9ca9-0659ef15128d\" } (ServiceError(ServiceError { source: Unhandled(Unhandled { source: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"9fc9947c-d497-4aee-9ca9-0659ef15128d\"}) }, meta: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"9fc9947c-d497-4aee-9ca9-0659ef15128d\"}) } }), raw: Response { status: StatusCode(501), headers: {\"access-control-allow-headers\": \"Content-Type, Authorization\", \"access-control-allow-methods\": \"GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS\", \"access-control-allow-origin\": \"*\", \"access-control-expose-headers\": \"ETag, X-Amz-*, X-*\", \"content-length\": \"289\", \"content-type\": \"text/xml\", \"x-amzn-requestid\": \"9fc9947c-d497-4aee-9ca9-0659ef15128d\", \"x-emulator-unsupported\": \"true\", \"date\": \"Thu, 24 Sep 2026 08:16:42 GMT\"}, body: SdkBody { inner: Once(Some(b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?>\\n<ErrorResponse><Error><Type>Sender</Type><Code>NotImplemented</Code><Message>This operation is not yet emulated. Check docs/services/ for the support matrix.</Message></Error><RequestId>9fc9947c-d497-4aee-9ca9-0659ef15128d</RequestId></ErrorResponse>\")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo, aws_runtime::service_clock_skew::ResponseClockSkew} } } }))" (compat/model/scenarios/iam.json call)
| |||||||
| GetOpenIDConnectProvider | AWS SDK for JavaScript v3: Not emulated yet | AWS SDK for Python (boto3): Not emulated yet | AWS SDK for Go v2: Not emulated yet | AWS CLI v2: Not emulated yet | AWS SDK for Java 2.x: Not emulated yet | AWS SDK for .NET: Not emulated yet | AWS SDK for Rust: Not emulated yet |
Why 7 results do not pass · 7 on Overcast AWS SDK for JavaScript v3, AWS SDK for Python (boto3), AWS SDK for Go v2, AWS CLI v2, AWS SDK for Java 2.x, AWS SDK for .NET, AWS SDK for Rust: Not emulated yet JS, Python, Go, CLI, Java, .NET, Rust
Report this
Overcast returned 501 Not Implemented: the operation has no emulation yet. Messages (6)AWS SDK for JavaScript v3 NotImplemented: iam-gen-probe/GetOpenIDConnectProvider: GetOpenIDConnectProvider params={"OpenIDConnectProviderArn":"arn:aws:iam::123456789012:oidc-provider/compat-scenario-nonexistent.example.com"} — call: expected the call to succeed, actual NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix. (compat/model/scenarios/iam.json call)
AWS SDK for Python (boto3) An error occurred (NotImplemented) when calling the GetOpenIDConnectProvider operation: This operation is not yet emulated. Check docs/services/ for the support matrix.
AWS SDK for Go v2 iam-gen-probe/GetOpenIDConnectProvider: GetOpenIDConnectProvider params {"OpenIDConnectProviderArn":"arn:aws:iam::123456789012:oidc-provider/compat-scenario-nonexistent.example.com"}: call: expected the call to succeed, actual "operation error IAM: GetOpenIDConnectProvider, https response error StatusCode: 501, RequestID: 4a8182db-e1b7-4e23-b1e1-b014451494dd, api error NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Java 2.x iam-gen-probe/GetOpenIDConnectProvider: GetOpenIDConnectProvider params {"OpenIDConnectProviderArn":"arn:aws:iam::123456789012:oidc-provider/compat-scenario-nonexistent.example.com"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix. (Service: Iam, Status Code: 501, Request ID: 03a7570a-a46b-47fd-8dad-b5183074566a) (SDK Attempt Count: 1)" (compat/model/scenarios/iam.json call)
AWS SDK for .NET iam-gen-probe/GetOpenIDConnectProvider: GetOpenIDConnectProvider params {"OpenIDConnectProviderArn":"arn:aws:iam::123456789012:oidc-provider/compat-scenario-nonexistent.example.com"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Rust iam-gen-probe/GetOpenIDConnectProvider: GetOpenIDConnectProvider params {"OpenIDConnectProviderArn":"arn:aws:iam::123456789012:oidc-provider/compat-scenario-nonexistent.example.com"}: call: expected the call to succeed, actual "service error: unhandled error (NotImplemented): Error { code: \"NotImplemented\", message: \"This operation is not yet emulated. Check docs/services/ for the support matrix.\", aws_request_id: \"0e7b092a-377a-4d4d-8301-555532434688\" } (ServiceError(ServiceError { source: Unhandled(Unhandled { source: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"0e7b092a-377a-4d4d-8301-555532434688\"}) }, meta: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"0e7b092a-377a-4d4d-8301-555532434688\"}) } }), raw: Response { status: StatusCode(501), headers: {\"access-control-allow-headers\": \"Content-Type, Authorization\", \"access-control-allow-methods\": \"GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS\", \"access-control-allow-origin\": \"*\", \"access-control-expose-headers\": \"ETag, X-Amz-*, X-*\", \"content-length\": \"289\", \"content-type\": \"text/xml\", \"x-amzn-requestid\": \"0e7b092a-377a-4d4d-8301-555532434688\", \"x-emulator-unsupported\": \"true\", \"date\": \"Thu, 24 Sep 2026 08:16:42 GMT\"}, body: SdkBody { inner: Once(Some(b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?>\\n<ErrorResponse><Error><Type>Sender</Type><Code>NotImplemented</Code><Message>This operation is not yet emulated. Check docs/services/ for the support matrix.</Message></Error><RequestId>0e7b092a-377a-4d4d-8301-555532434688</RequestId></ErrorResponse>\")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo, aws_runtime::service_clock_skew::ResponseClockSkew} } } }))" (compat/model/scenarios/iam.json call)
| |||||||
| GetOrganizationsAccessReport | AWS SDK for JavaScript v3: Not emulated yet | AWS SDK for Python (boto3): Not emulated yet | AWS SDK for Go v2: Not emulated yet | AWS CLI v2: Not emulated yet | AWS SDK for Java 2.x: Not emulated yet | AWS SDK for .NET: Not emulated yet | AWS SDK for Rust: Not emulated yet |
Why 7 results do not pass · 7 on Overcast AWS SDK for JavaScript v3, AWS SDK for Python (boto3), AWS SDK for Go v2, AWS CLI v2, AWS SDK for Java 2.x, AWS SDK for .NET, AWS SDK for Rust: Not emulated yet JS, Python, Go, CLI, Java, .NET, Rust
Report this
Overcast returned 501 Not Implemented: the operation has no emulation yet. Messages (6)AWS SDK for JavaScript v3 NotImplemented: iam-gen-probe/GetOrganizationsAccessReport: GetOrganizationsAccessReport params={"JobId":"00000000-0000-0000-0000-000000000000"} — call: expected the call to succeed, actual NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix. (compat/model/scenarios/iam.json call)
AWS SDK for Python (boto3) An error occurred (NotImplemented) when calling the GetOrganizationsAccessReport operation: This operation is not yet emulated. Check docs/services/ for the support matrix.
AWS SDK for Go v2 iam-gen-probe/GetOrganizationsAccessReport: GetOrganizationsAccessReport params {"JobId":"00000000-0000-0000-0000-000000000000","SortKey":""}: call: expected the call to succeed, actual "operation error IAM: GetOrganizationsAccessReport, https response error StatusCode: 501, RequestID: e9f0126a-6943-47ec-a9c9-44d1cece73bd, api error NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Java 2.x iam-gen-probe/GetOrganizationsAccessReport: GetOrganizationsAccessReport params {"JobId":"00000000-0000-0000-0000-000000000000"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix. (Service: Iam, Status Code: 501, Request ID: 4459b27e-aabf-4118-abdd-369b29a58c32) (SDK Attempt Count: 1)" (compat/model/scenarios/iam.json call)
AWS SDK for .NET iam-gen-probe/GetOrganizationsAccessReport: GetOrganizationsAccessReport params {"JobId":"00000000-0000-0000-0000-000000000000"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Rust iam-gen-probe/GetOrganizationsAccessReport: GetOrganizationsAccessReport params {"JobId":"00000000-0000-0000-0000-000000000000"}: call: expected the call to succeed, actual "service error: unhandled error (NotImplemented): Error { code: \"NotImplemented\", message: \"This operation is not yet emulated. Check docs/services/ for the support matrix.\", aws_request_id: \"e9ceb548-ca9d-42f9-af31-61d13b3483d5\" } (ServiceError(ServiceError { source: Unhandled(Unhandled { source: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"e9ceb548-ca9d-42f9-af31-61d13b3483d5\"}) }, meta: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"e9ceb548-ca9d-42f9-af31-61d13b3483d5\"}) } }), raw: Response { status: StatusCode(501), headers: {\"access-control-allow-headers\": \"Content-Type, Authorization\", \"access-control-allow-methods\": \"GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS\", \"access-control-allow-origin\": \"*\", \"access-control-expose-headers\": \"ETag, X-Amz-*, X-*\", \"content-length\": \"289\", \"content-type\": \"text/xml\", \"x-amzn-requestid\": \"e9ceb548-ca9d-42f9-af31-61d13b3483d5\", \"x-emulator-unsupported\": \"true\", \"date\": \"Thu, 24 Sep 2026 08:16:42 GMT\"}, body: SdkBody { inner: Once(Some(b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?>\\n<ErrorResponse><Error><Type>Sender</Type><Code>NotImplemented</Code><Message>This operation is not yet emulated. Check docs/services/ for the support matrix.</Message></Error><RequestId>e9ceb548-ca9d-42f9-af31-61d13b3483d5</RequestId></ErrorResponse>\")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo, aws_runtime::service_clock_skew::ResponseClockSkew} } } }))" (compat/model/scenarios/iam.json call)
| |||||||
| GetOutboundWebIdentityFederationInfo | AWS SDK for JavaScript v3: Not emulated yet | AWS SDK for Python (boto3): Not emulated yet | AWS SDK for Go v2: Not emulated yet | AWS CLI v2: Not emulated yet | AWS SDK for Java 2.x: Not emulated yet | AWS SDK for .NET: Not emulated yet | AWS SDK for Rust: Not emulated yet |
Why 7 results do not pass · 7 on Overcast AWS SDK for JavaScript v3, AWS SDK for Python (boto3), AWS SDK for Go v2, AWS CLI v2, AWS SDK for Java 2.x, AWS SDK for .NET, AWS SDK for Rust: Not emulated yet JS, Python, Go, CLI, Java, .NET, Rust
Report this
Overcast returned 501 Not Implemented: the operation has no emulation yet. Messages (6)AWS SDK for JavaScript v3 NotImplemented: iam-gen-probe/GetOutboundWebIdentityFederationInfo: GetOutboundWebIdentityFederationInfo params={} — call: expected the call to succeed, actual NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix. (compat/model/scenarios/iam.json call)
AWS SDK for Python (boto3) An error occurred (NotImplemented) when calling the GetOutboundWebIdentityFederationInfo operation: This operation is not yet emulated. Check docs/services/ for the support matrix.
AWS SDK for Go v2 iam-gen-probe/GetOutboundWebIdentityFederationInfo: GetOutboundWebIdentityFederationInfo params {}: call: expected the call to succeed, actual "operation error IAM: GetOutboundWebIdentityFederationInfo, https response error StatusCode: 501, RequestID: 9db4d815-9e25-4630-95a9-67d88211cfe4, api error NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Java 2.x iam-gen-probe/GetOutboundWebIdentityFederationInfo: GetOutboundWebIdentityFederationInfo params {}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix. (Service: Iam, Status Code: 501, Request ID: c12cc9c8-020e-45e1-b77c-22517e53c32a) (SDK Attempt Count: 1)" (compat/model/scenarios/iam.json call)
AWS SDK for .NET iam-gen-probe/GetOutboundWebIdentityFederationInfo: GetOutboundWebIdentityFederationInfo params {}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Rust iam-gen-probe/GetOutboundWebIdentityFederationInfo: GetOutboundWebIdentityFederationInfo params {}: call: expected the call to succeed, actual "service error: unhandled error (NotImplemented): Error { code: \"NotImplemented\", message: \"This operation is not yet emulated. Check docs/services/ for the support matrix.\", aws_request_id: \"b4069141-93c8-420a-949e-72c8b6491d5d\" } (ServiceError(ServiceError { source: Unhandled(Unhandled { source: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"b4069141-93c8-420a-949e-72c8b6491d5d\"}) }, meta: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"b4069141-93c8-420a-949e-72c8b6491d5d\"}) } }), raw: Response { status: StatusCode(501), headers: {\"access-control-allow-headers\": \"Content-Type, Authorization\", \"access-control-allow-methods\": \"GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS\", \"access-control-allow-origin\": \"*\", \"access-control-expose-headers\": \"ETag, X-Amz-*, X-*\", \"content-length\": \"289\", \"content-type\": \"text/xml\", \"x-amzn-requestid\": \"b4069141-93c8-420a-949e-72c8b6491d5d\", \"x-emulator-unsupported\": \"true\", \"date\": \"Thu, 24 Sep 2026 08:16:43 GMT\"}, body: SdkBody { inner: Once(Some(b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?>\\n<ErrorResponse><Error><Type>Sender</Type><Code>NotImplemented</Code><Message>This operation is not yet emulated. Check docs/services/ for the support matrix.</Message></Error><RequestId>b4069141-93c8-420a-949e-72c8b6491d5d</RequestId></ErrorResponse>\")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo, aws_runtime::service_clock_skew::ResponseClockSkew} } } }))" (compat/model/scenarios/iam.json call)
| |||||||
| GetPolicyVersion | AWS SDK for JavaScript v3: Not emulated yet | AWS SDK for Python (boto3): Not emulated yet | AWS SDK for Go v2: Not emulated yet | AWS CLI v2: Not emulated yet | AWS SDK for Java 2.x: Not emulated yet | AWS SDK for .NET: Not emulated yet | AWS SDK for Rust: Not emulated yet |
Why 7 results do not pass · 7 on Overcast AWS SDK for JavaScript v3, AWS SDK for Python (boto3), AWS SDK for Go v2, AWS CLI v2, AWS SDK for Java 2.x, AWS SDK for .NET, AWS SDK for Rust: Not emulated yet JS, Python, Go, CLI, Java, .NET, Rust
Report this
Overcast returned 501 Not Implemented: the operation has no emulation yet. Messages (6)AWS SDK for JavaScript v3 NotImplemented: iam-gen-probe/GetPolicyVersion: GetPolicyVersion params={"PolicyArn":"arn:aws:iam::123456789012:policy/compat-scenario-nonexistent","VersionId":"v1"} — call: expected the call to succeed, actual NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix. (compat/model/scenarios/iam.json call)
AWS SDK for Python (boto3) An error occurred (NotImplemented) when calling the GetPolicyVersion operation: This operation is not yet emulated. Check docs/services/ for the support matrix.
AWS SDK for Go v2 iam-gen-probe/GetPolicyVersion: GetPolicyVersion params {"PolicyArn":"arn:aws:iam::123456789012:policy/compat-scenario-nonexistent","VersionId":"v1"}: call: expected the call to succeed, actual "operation error IAM: GetPolicyVersion, https response error StatusCode: 501, RequestID: 7fae2ab7-6b6e-4957-af38-dac586ccda9e, api error NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Java 2.x iam-gen-probe/GetPolicyVersion: GetPolicyVersion params {"PolicyArn":"arn:aws:iam::123456789012:policy/compat-scenario-nonexistent","VersionId":"v1"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix. (Service: Iam, Status Code: 501, Request ID: 272a1a11-4b84-442b-859f-6842d6978d67) (SDK Attempt Count: 1)" (compat/model/scenarios/iam.json call)
AWS SDK for .NET iam-gen-probe/GetPolicyVersion: GetPolicyVersion params {"PolicyArn":"arn:aws:iam::123456789012:policy/compat-scenario-nonexistent","VersionId":"v1"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Rust iam-gen-probe/GetPolicyVersion: GetPolicyVersion params {"PolicyArn":"arn:aws:iam::123456789012:policy/compat-scenario-nonexistent","VersionId":"v1"}: call: expected the call to succeed, actual "service error: unhandled error (NotImplemented): Error { code: \"NotImplemented\", message: \"This operation is not yet emulated. Check docs/services/ for the support matrix.\", aws_request_id: \"164ae103-a14e-4aa4-97e8-ebbb251e11bc\" } (ServiceError(ServiceError { source: Unhandled(Unhandled { source: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"164ae103-a14e-4aa4-97e8-ebbb251e11bc\"}) }, meta: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"164ae103-a14e-4aa4-97e8-ebbb251e11bc\"}) } }), raw: Response { status: StatusCode(501), headers: {\"access-control-allow-headers\": \"Content-Type, Authorization\", \"access-control-allow-methods\": \"GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS\", \"access-control-allow-origin\": \"*\", \"access-control-expose-headers\": \"ETag, X-Amz-*, X-*\", \"content-length\": \"289\", \"content-type\": \"text/xml\", \"x-amzn-requestid\": \"164ae103-a14e-4aa4-97e8-ebbb251e11bc\", \"x-emulator-unsupported\": \"true\", \"date\": \"Thu, 24 Sep 2026 08:16:43 GMT\"}, body: SdkBody { inner: Once(Some(b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?>\\n<ErrorResponse><Error><Type>Sender</Type><Code>NotImplemented</Code><Message>This operation is not yet emulated. Check docs/services/ for the support matrix.</Message></Error><RequestId>164ae103-a14e-4aa4-97e8-ebbb251e11bc</RequestId></ErrorResponse>\")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo, aws_runtime::service_clock_skew::ResponseClockSkew} } } }))" (compat/model/scenarios/iam.json call)
| |||||||
| GetSAMLProvider | AWS SDK for JavaScript v3: Not emulated yet | AWS SDK for Python (boto3): Not emulated yet | AWS SDK for Go v2: Not emulated yet | AWS CLI v2: Not emulated yet | AWS SDK for Java 2.x: Not emulated yet | AWS SDK for .NET: Not emulated yet | AWS SDK for Rust: Not emulated yet |
Why 7 results do not pass · 7 on Overcast AWS SDK for JavaScript v3, AWS SDK for Python (boto3), AWS SDK for Go v2, AWS CLI v2, AWS SDK for Java 2.x, AWS SDK for .NET, AWS SDK for Rust: Not emulated yet JS, Python, Go, CLI, Java, .NET, Rust
Report this
Overcast returned 501 Not Implemented: the operation has no emulation yet. Messages (6)AWS SDK for JavaScript v3 NotImplemented: iam-gen-probe/GetSAMLProvider: GetSAMLProvider params={"SAMLProviderArn":"arn:aws:iam::123456789012:saml-provider/compat-scenario-nonexistent"} — call: expected the call to succeed, actual NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix. (compat/model/scenarios/iam.json call)
AWS SDK for Python (boto3) An error occurred (NotImplemented) when calling the GetSAMLProvider operation: This operation is not yet emulated. Check docs/services/ for the support matrix.
AWS SDK for Go v2 iam-gen-probe/GetSAMLProvider: GetSAMLProvider params {"SAMLProviderArn":"arn:aws:iam::123456789012:saml-provider/compat-scenario-nonexistent"}: call: expected the call to succeed, actual "operation error IAM: GetSAMLProvider, https response error StatusCode: 501, RequestID: 2a76060c-9cec-47a4-8116-56c1a26f6a24, api error NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Java 2.x iam-gen-probe/GetSAMLProvider: GetSAMLProvider params {"SAMLProviderArn":"arn:aws:iam::123456789012:saml-provider/compat-scenario-nonexistent"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix. (Service: Iam, Status Code: 501, Request ID: f3aaa655-295e-4de9-b512-af4530719391) (SDK Attempt Count: 1)" (compat/model/scenarios/iam.json call)
AWS SDK for .NET iam-gen-probe/GetSAMLProvider: GetSAMLProvider params {"SAMLProviderArn":"arn:aws:iam::123456789012:saml-provider/compat-scenario-nonexistent"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Rust iam-gen-probe/GetSAMLProvider: GetSAMLProvider params {"SAMLProviderArn":"arn:aws:iam::123456789012:saml-provider/compat-scenario-nonexistent"}: call: expected the call to succeed, actual "service error: unhandled error (NotImplemented): Error { code: \"NotImplemented\", message: \"This operation is not yet emulated. Check docs/services/ for the support matrix.\", aws_request_id: \"a1beab15-1ad2-4b75-a585-10aacab471b7\" } (ServiceError(ServiceError { source: Unhandled(Unhandled { source: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"a1beab15-1ad2-4b75-a585-10aacab471b7\"}) }, meta: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"a1beab15-1ad2-4b75-a585-10aacab471b7\"}) } }), raw: Response { status: StatusCode(501), headers: {\"access-control-allow-headers\": \"Content-Type, Authorization\", \"access-control-allow-methods\": \"GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS\", \"access-control-allow-origin\": \"*\", \"access-control-expose-headers\": \"ETag, X-Amz-*, X-*\", \"content-length\": \"289\", \"content-type\": \"text/xml\", \"x-amzn-requestid\": \"a1beab15-1ad2-4b75-a585-10aacab471b7\", \"x-emulator-unsupported\": \"true\", \"date\": \"Thu, 24 Sep 2026 08:16:43 GMT\"}, body: SdkBody { inner: Once(Some(b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?>\\n<ErrorResponse><Error><Type>Sender</Type><Code>NotImplemented</Code><Message>This operation is not yet emulated. Check docs/services/ for the support matrix.</Message></Error><RequestId>a1beab15-1ad2-4b75-a585-10aacab471b7</RequestId></ErrorResponse>\")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo, aws_runtime::service_clock_skew::ResponseClockSkew} } } }))" (compat/model/scenarios/iam.json call)
| |||||||
| GetSSHPublicKey | AWS SDK for JavaScript v3: Not emulated yet | AWS SDK for Python (boto3): Not emulated yet | AWS SDK for Go v2: Not emulated yet | AWS CLI v2: Not emulated yet | AWS SDK for Java 2.x: Not emulated yet | AWS SDK for .NET: Not emulated yet | AWS SDK for Rust: Not emulated yet |
Why 7 results do not pass · 7 on Overcast AWS SDK for JavaScript v3, AWS SDK for Python (boto3), AWS SDK for Go v2, AWS CLI v2, AWS SDK for Java 2.x, AWS SDK for .NET, AWS SDK for Rust: Not emulated yet JS, Python, Go, CLI, Java, .NET, Rust
Report this
Overcast returned 501 Not Implemented: the operation has no emulation yet. Messages (6)AWS SDK for JavaScript v3 NotImplemented: iam-gen-probe/GetSSHPublicKey: GetSSHPublicKey params={"Encoding":"PEM","SSHPublicKeyId":"APKAEIBAERJR2EXAMPLE","UserName":"compat-scenario-nonexistent"} — call: expected the call to succeed, actual NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix. (compat/model/scenarios/iam.json call)
AWS SDK for Python (boto3) An error occurred (NotImplemented) when calling the GetSSHPublicKey operation: This operation is not yet emulated. Check docs/services/ for the support matrix.
AWS SDK for Go v2 iam-gen-probe/GetSSHPublicKey: GetSSHPublicKey params {"Encoding":"PEM","SSHPublicKeyId":"APKAEIBAERJR2EXAMPLE","UserName":"compat-scenario-nonexistent"}: call: expected the call to succeed, actual "operation error IAM: GetSSHPublicKey, https response error StatusCode: 501, RequestID: 228a745f-60ce-4e38-a321-5a48b9d964d3, api error NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Java 2.x iam-gen-probe/GetSSHPublicKey: GetSSHPublicKey params {"Encoding":"PEM","SSHPublicKeyId":"APKAEIBAERJR2EXAMPLE","UserName":"compat-scenario-nonexistent"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix. (Service: Iam, Status Code: 501, Request ID: cbfe646a-360b-451e-8560-f50f891272dd) (SDK Attempt Count: 1)" (compat/model/scenarios/iam.json call)
AWS SDK for .NET iam-gen-probe/GetSSHPublicKey: GetSSHPublicKey params {"Encoding":"PEM","SSHPublicKeyId":"APKAEIBAERJR2EXAMPLE","UserName":"compat-scenario-nonexistent"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Rust iam-gen-probe/GetSSHPublicKey: GetSSHPublicKey params {"Encoding":"PEM","SSHPublicKeyId":"APKAEIBAERJR2EXAMPLE","UserName":"compat-scenario-nonexistent"}: call: expected the call to succeed, actual "service error: unhandled error (NotImplemented): Error { code: \"NotImplemented\", message: \"This operation is not yet emulated. Check docs/services/ for the support matrix.\", aws_request_id: \"c364756b-8fbb-4a3e-b533-e39a151da03a\" } (ServiceError(ServiceError { source: Unhandled(Unhandled { source: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"c364756b-8fbb-4a3e-b533-e39a151da03a\"}) }, meta: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"c364756b-8fbb-4a3e-b533-e39a151da03a\"}) } }), raw: Response { status: StatusCode(501), headers: {\"access-control-allow-headers\": \"Content-Type, Authorization\", \"access-control-allow-methods\": \"GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS\", \"access-control-allow-origin\": \"*\", \"access-control-expose-headers\": \"ETag, X-Amz-*, X-*\", \"content-length\": \"289\", \"content-type\": \"text/xml\", \"x-amzn-requestid\": \"c364756b-8fbb-4a3e-b533-e39a151da03a\", \"x-emulator-unsupported\": \"true\", \"date\": \"Thu, 24 Sep 2026 08:16:43 GMT\"}, body: SdkBody { inner: Once(Some(b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?>\\n<ErrorResponse><Error><Type>Sender</Type><Code>NotImplemented</Code><Message>This operation is not yet emulated. Check docs/services/ for the support matrix.</Message></Error><RequestId>c364756b-8fbb-4a3e-b533-e39a151da03a</RequestId></ErrorResponse>\")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo, aws_runtime::service_clock_skew::ResponseClockSkew} } } }))" (compat/model/scenarios/iam.json call)
| |||||||
| GetServerCertificate | AWS SDK for JavaScript v3: Not emulated yet | AWS SDK for Python (boto3): Not emulated yet | AWS SDK for Go v2: Not emulated yet | AWS CLI v2: Not emulated yet | AWS SDK for Java 2.x: Not emulated yet | AWS SDK for .NET: Not emulated yet | AWS SDK for Rust: Not emulated yet |
Why 7 results do not pass · 7 on Overcast AWS SDK for JavaScript v3, AWS SDK for Python (boto3), AWS SDK for Go v2, AWS CLI v2, AWS SDK for Java 2.x, AWS SDK for .NET, AWS SDK for Rust: Not emulated yet JS, Python, Go, CLI, Java, .NET, Rust
Report this
Overcast returned 501 Not Implemented: the operation has no emulation yet. Messages (6)AWS SDK for JavaScript v3 NotImplemented: iam-gen-probe/GetServerCertificate: GetServerCertificate params={"ServerCertificateName":"compat-scenario-nonexistent"} — call: expected the call to succeed, actual NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix. (compat/model/scenarios/iam.json call)
AWS SDK for Python (boto3) An error occurred (NotImplemented) when calling the GetServerCertificate operation: This operation is not yet emulated. Check docs/services/ for the support matrix.
AWS SDK for Go v2 iam-gen-probe/GetServerCertificate: GetServerCertificate params {"ServerCertificateName":"compat-scenario-nonexistent"}: call: expected the call to succeed, actual "operation error IAM: GetServerCertificate, https response error StatusCode: 501, RequestID: 912d8b82-89f0-4429-a522-59b56316f4fb, api error NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Java 2.x iam-gen-probe/GetServerCertificate: GetServerCertificate params {"ServerCertificateName":"compat-scenario-nonexistent"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix. (Service: Iam, Status Code: 501, Request ID: 44b3a0be-c013-4d76-a0b4-bc9a8a2f9e14) (SDK Attempt Count: 1)" (compat/model/scenarios/iam.json call)
AWS SDK for .NET iam-gen-probe/GetServerCertificate: GetServerCertificate params {"ServerCertificateName":"compat-scenario-nonexistent"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Rust iam-gen-probe/GetServerCertificate: GetServerCertificate params {"ServerCertificateName":"compat-scenario-nonexistent"}: call: expected the call to succeed, actual "service error: unhandled error (NotImplemented): Error { code: \"NotImplemented\", message: \"This operation is not yet emulated. Check docs/services/ for the support matrix.\", aws_request_id: \"a09ba447-e4d4-4c54-aefb-b1fb43e67c8b\" } (ServiceError(ServiceError { source: Unhandled(Unhandled { source: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"a09ba447-e4d4-4c54-aefb-b1fb43e67c8b\"}) }, meta: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"a09ba447-e4d4-4c54-aefb-b1fb43e67c8b\"}) } }), raw: Response { status: StatusCode(501), headers: {\"access-control-allow-headers\": \"Content-Type, Authorization\", \"access-control-allow-methods\": \"GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS\", \"access-control-allow-origin\": \"*\", \"access-control-expose-headers\": \"ETag, X-Amz-*, X-*\", \"content-length\": \"289\", \"content-type\": \"text/xml\", \"x-amzn-requestid\": \"a09ba447-e4d4-4c54-aefb-b1fb43e67c8b\", \"x-emulator-unsupported\": \"true\", \"date\": \"Thu, 24 Sep 2026 08:16:43 GMT\"}, body: SdkBody { inner: Once(Some(b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?>\\n<ErrorResponse><Error><Type>Sender</Type><Code>NotImplemented</Code><Message>This operation is not yet emulated. Check docs/services/ for the support matrix.</Message></Error><RequestId>a09ba447-e4d4-4c54-aefb-b1fb43e67c8b</RequestId></ErrorResponse>\")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo, aws_runtime::service_clock_skew::ResponseClockSkew} } } }))" (compat/model/scenarios/iam.json call)
| |||||||
| GetServiceLastAccessedDetails | AWS SDK for JavaScript v3: Not emulated yet | AWS SDK for Python (boto3): Not emulated yet | AWS SDK for Go v2: Not emulated yet | AWS CLI v2: Not emulated yet | AWS SDK for Java 2.x: Not emulated yet | AWS SDK for .NET: Not emulated yet | AWS SDK for Rust: Not emulated yet |
Why 7 results do not pass · 7 on Overcast AWS SDK for JavaScript v3, AWS SDK for Python (boto3), AWS SDK for Go v2, AWS CLI v2, AWS SDK for Java 2.x, AWS SDK for .NET, AWS SDK for Rust: Not emulated yet JS, Python, Go, CLI, Java, .NET, Rust
Report this
Overcast returned 501 Not Implemented: the operation has no emulation yet. Messages (6)AWS SDK for JavaScript v3 NotImplemented: iam-gen-probe/GetServiceLastAccessedDetails: GetServiceLastAccessedDetails params={"JobId":"00000000-0000-0000-0000-000000000000"} — call: expected the call to succeed, actual NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix. (compat/model/scenarios/iam.json call)
AWS SDK for Python (boto3) An error occurred (NotImplemented) when calling the GetServiceLastAccessedDetails operation: This operation is not yet emulated. Check docs/services/ for the support matrix.
AWS SDK for Go v2 iam-gen-probe/GetServiceLastAccessedDetails: GetServiceLastAccessedDetails params {"JobId":"00000000-0000-0000-0000-000000000000"}: call: expected the call to succeed, actual "operation error IAM: GetServiceLastAccessedDetails, https response error StatusCode: 501, RequestID: 4c69e78f-6742-44a3-9b18-28d3197a8efa, api error NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Java 2.x iam-gen-probe/GetServiceLastAccessedDetails: GetServiceLastAccessedDetails params {"JobId":"00000000-0000-0000-0000-000000000000"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix. (Service: Iam, Status Code: 501, Request ID: 97a3a1bf-34ff-406e-858c-30012e646a21) (SDK Attempt Count: 1)" (compat/model/scenarios/iam.json call)
AWS SDK for .NET iam-gen-probe/GetServiceLastAccessedDetails: GetServiceLastAccessedDetails params {"JobId":"00000000-0000-0000-0000-000000000000"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Rust iam-gen-probe/GetServiceLastAccessedDetails: GetServiceLastAccessedDetails params {"JobId":"00000000-0000-0000-0000-000000000000"}: call: expected the call to succeed, actual "service error: unhandled error (NotImplemented): Error { code: \"NotImplemented\", message: \"This operation is not yet emulated. Check docs/services/ for the support matrix.\", aws_request_id: \"2da8beac-9b67-4752-8aea-2cf46838d8c6\" } (ServiceError(ServiceError { source: Unhandled(Unhandled { source: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"2da8beac-9b67-4752-8aea-2cf46838d8c6\"}) }, meta: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"2da8beac-9b67-4752-8aea-2cf46838d8c6\"}) } }), raw: Response { status: StatusCode(501), headers: {\"access-control-allow-headers\": \"Content-Type, Authorization\", \"access-control-allow-methods\": \"GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS\", \"access-control-allow-origin\": \"*\", \"access-control-expose-headers\": \"ETag, X-Amz-*, X-*\", \"content-length\": \"289\", \"content-type\": \"text/xml\", \"x-amzn-requestid\": \"2da8beac-9b67-4752-8aea-2cf46838d8c6\", \"x-emulator-unsupported\": \"true\", \"date\": \"Thu, 24 Sep 2026 08:16:43 GMT\"}, body: SdkBody { inner: Once(Some(b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?>\\n<ErrorResponse><Error><Type>Sender</Type><Code>NotImplemented</Code><Message>This operation is not yet emulated. Check docs/services/ for the support matrix.</Message></Error><RequestId>2da8beac-9b67-4752-8aea-2cf46838d8c6</RequestId></ErrorResponse>\")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo, aws_runtime::service_clock_skew::ResponseClockSkew} } } }))" (compat/model/scenarios/iam.json call)
| |||||||
| GetServiceLastAccessedDetailsWithEntities | AWS SDK for JavaScript v3: Not emulated yet | AWS SDK for Python (boto3): Not emulated yet | AWS SDK for Go v2: Not emulated yet | AWS CLI v2: Not emulated yet | AWS SDK for Java 2.x: Not emulated yet | AWS SDK for .NET: Not emulated yet | AWS SDK for Rust: Not emulated yet |
Why 7 results do not pass · 7 on Overcast AWS SDK for JavaScript v3, AWS SDK for Python (boto3), AWS SDK for Go v2, AWS CLI v2, AWS SDK for Java 2.x, AWS SDK for .NET, AWS SDK for Rust: Not emulated yet JS, Python, Go, CLI, Java, .NET, Rust
Report this
Overcast returned 501 Not Implemented: the operation has no emulation yet. Messages (6)AWS SDK for JavaScript v3 NotImplemented: iam-gen-probe/GetServiceLastAccessedDetailsWithEntities: GetServiceLastAccessedDetailsWithEntities params={"JobId":"00000000-0000-0000-0000-000000000000","ServiceNamespace":"s3"} — call: expected the call to succeed, actual NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix. (compat/model/scenarios/iam.json call)
AWS SDK for Python (boto3) An error occurred (NotImplemented) when calling the GetServiceLastAccessedDetailsWithEntities operation: This operation is not yet emulated. Check docs/services/ for the support matrix.
AWS SDK for Go v2 iam-gen-probe/GetServiceLastAccessedDetailsWithEntities: GetServiceLastAccessedDetailsWithEntities params {"JobId":"00000000-0000-0000-0000-000000000000","ServiceNamespace":"s3"}: call: expected the call to succeed, actual "operation error IAM: GetServiceLastAccessedDetailsWithEntities, https response error StatusCode: 501, RequestID: 05925e1d-6a7a-4d6e-b795-1fc731a105c6, api error NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Java 2.x iam-gen-probe/GetServiceLastAccessedDetailsWithEntities: GetServiceLastAccessedDetailsWithEntities params {"JobId":"00000000-0000-0000-0000-000000000000","ServiceNamespace":"s3"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix. (Service: Iam, Status Code: 501, Request ID: e675cc67-9df8-49d2-86de-a9814e209d84) (SDK Attempt Count: 1)" (compat/model/scenarios/iam.json call)
AWS SDK for .NET iam-gen-probe/GetServiceLastAccessedDetailsWithEntities: GetServiceLastAccessedDetailsWithEntities params {"JobId":"00000000-0000-0000-0000-000000000000","ServiceNamespace":"s3"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Rust iam-gen-probe/GetServiceLastAccessedDetailsWithEntities: GetServiceLastAccessedDetailsWithEntities params {"JobId":"00000000-0000-0000-0000-000000000000","ServiceNamespace":"s3"}: call: expected the call to succeed, actual "service error: unhandled error (NotImplemented): Error { code: \"NotImplemented\", message: \"This operation is not yet emulated. Check docs/services/ for the support matrix.\", aws_request_id: \"7d13520d-8d7b-481b-9e65-146cb52954c3\" } (ServiceError(ServiceError { source: Unhandled(Unhandled { source: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"7d13520d-8d7b-481b-9e65-146cb52954c3\"}) }, meta: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"7d13520d-8d7b-481b-9e65-146cb52954c3\"}) } }), raw: Response { status: StatusCode(501), headers: {\"access-control-allow-headers\": \"Content-Type, Authorization\", \"access-control-allow-methods\": \"GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS\", \"access-control-allow-origin\": \"*\", \"access-control-expose-headers\": \"ETag, X-Amz-*, X-*\", \"content-length\": \"289\", \"content-type\": \"text/xml\", \"x-amzn-requestid\": \"7d13520d-8d7b-481b-9e65-146cb52954c3\", \"x-emulator-unsupported\": \"true\", \"date\": \"Thu, 24 Sep 2026 08:16:43 GMT\"}, body: SdkBody { inner: Once(Some(b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?>\\n<ErrorResponse><Error><Type>Sender</Type><Code>NotImplemented</Code><Message>This operation is not yet emulated. Check docs/services/ for the support matrix.</Message></Error><RequestId>7d13520d-8d7b-481b-9e65-146cb52954c3</RequestId></ErrorResponse>\")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo, aws_runtime::service_clock_skew::ResponseClockSkew} } } }))" (compat/model/scenarios/iam.json call)
| |||||||
| GetServiceLinkedRoleDeletionStatus | AWS SDK for JavaScript v3: Not emulated yet | AWS SDK for Python (boto3): Not emulated yet | AWS SDK for Go v2: Not emulated yet | AWS CLI v2: Not emulated yet | AWS SDK for Java 2.x: Not emulated yet | AWS SDK for .NET: Not emulated yet | AWS SDK for Rust: Not emulated yet |
Why 7 results do not pass · 7 on Overcast AWS SDK for JavaScript v3, AWS SDK for Python (boto3), AWS SDK for Go v2, AWS CLI v2, AWS SDK for Java 2.x, AWS SDK for .NET, AWS SDK for Rust: Not emulated yet JS, Python, Go, CLI, Java, .NET, Rust
Report this
Overcast returned 501 Not Implemented: the operation has no emulation yet. Messages (6)AWS SDK for JavaScript v3 NotImplemented: iam-gen-probe/GetServiceLinkedRoleDeletionStatus: GetServiceLinkedRoleDeletionStatus params={"DeletionTaskId":"task/aws-service-role/compat-scenario-nonexistent.amazonaws.com/AWSServiceRoleForCompatScenario/00000000-0000-0000-0000-000000000000"} — call: expected the call to succeed, actual NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix. (compat/model/scenarios/iam.json call)
AWS SDK for Python (boto3) An error occurred (NotImplemented) when calling the GetServiceLinkedRoleDeletionStatus operation: This operation is not yet emulated. Check docs/services/ for the support matrix.
AWS SDK for Go v2 iam-gen-probe/GetServiceLinkedRoleDeletionStatus: GetServiceLinkedRoleDeletionStatus params {"DeletionTaskId":"task/aws-service-role/compat-scenario-nonexistent.amazonaws.com/AWSServiceRoleForCompatScenario/00000000-0000-0000-0000-000000000000"}: call: expected the call to succeed, actual "operation error IAM: GetServiceLinkedRoleDeletionStatus, https response error StatusCode: 501, RequestID: c5d10a73-388f-47c4-8fe8-7c5b9eb6294f, api error NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Java 2.x iam-gen-probe/GetServiceLinkedRoleDeletionStatus: GetServiceLinkedRoleDeletionStatus params {"DeletionTaskId":"task/aws-service-role/compat-scenario-nonexistent.amazonaws.com/AWSServiceRoleForCompatScenario/00000000-0000-0000-0000-000000000000"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix. (Service: Iam, Status Code: 501, Request ID: 019b0149-33ee-4792-a3df-3ba1db21ac8e) (SDK Attempt Count: 1)" (compat/model/scenarios/iam.json call)
AWS SDK for .NET iam-gen-probe/GetServiceLinkedRoleDeletionStatus: GetServiceLinkedRoleDeletionStatus params {"DeletionTaskId":"task/aws-service-role/compat-scenario-nonexistent.amazonaws.com/AWSServiceRoleForCompatScenario/00000000-0000-0000-0000-000000000000"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Rust iam-gen-probe/GetServiceLinkedRoleDeletionStatus: GetServiceLinkedRoleDeletionStatus params {"DeletionTaskId":"task/aws-service-role/compat-scenario-nonexistent.amazonaws.com/AWSServiceRoleForCompatScenario/00000000-0000-0000-0000-000000000000"}: call: expected the call to succeed, actual "service error: unhandled error (NotImplemented): Error { code: \"NotImplemented\", message: \"This operation is not yet emulated. Check docs/services/ for the support matrix.\", aws_request_id: \"44456f48-7336-4aa9-88f6-f1ac1787d150\" } (ServiceError(ServiceError { source: Unhandled(Unhandled { source: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"44456f48-7336-4aa9-88f6-f1ac1787d150\"}) }, meta: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"44456f48-7336-4aa9-88f6-f1ac1787d150\"}) } }), raw: Response { status: StatusCode(501), headers: {\"access-control-allow-headers\": \"Content-Type, Authorization\", \"access-control-allow-methods\": \"GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS\", \"access-control-allow-origin\": \"*\", \"access-control-expose-headers\": \"ETag, X-Amz-*, X-*\", \"content-length\": \"289\", \"content-type\": \"text/xml\", \"x-amzn-requestid\": \"44456f48-7336-4aa9-88f6-f1ac1787d150\", \"x-emulator-unsupported\": \"true\", \"date\": \"Thu, 24 Sep 2026 08:16:43 GMT\"}, body: SdkBody { inner: Once(Some(b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?>\\n<ErrorResponse><Error><Type>Sender</Type><Code>NotImplemented</Code><Message>This operation is not yet emulated. Check docs/services/ for the support matrix.</Message></Error><RequestId>44456f48-7336-4aa9-88f6-f1ac1787d150</RequestId></ErrorResponse>\")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo, aws_runtime::service_clock_skew::ResponseClockSkew} } } }))" (compat/model/scenarios/iam.json call)
| |||||||
| ListAccountAliases | AWS SDK for JavaScript v3: Not emulated yet | AWS SDK for Python (boto3): Not emulated yet | AWS SDK for Go v2: Not emulated yet | AWS CLI v2: Not emulated yet | AWS SDK for Java 2.x: Not emulated yet | AWS SDK for .NET: Not emulated yet | AWS SDK for Rust: Not emulated yet |
Why 7 results do not pass · 7 on Overcast AWS SDK for JavaScript v3, AWS SDK for Python (boto3), AWS SDK for Go v2, AWS CLI v2, AWS SDK for Java 2.x, AWS SDK for .NET, AWS SDK for Rust: Not emulated yet JS, Python, Go, CLI, Java, .NET, Rust
Report this
Overcast returned 501 Not Implemented: the operation has no emulation yet. Messages (6)AWS SDK for JavaScript v3 NotImplemented: iam-gen-probe/ListAccountAliases: ListAccountAliases params={} — call: expected the call to succeed, actual NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix. (compat/model/scenarios/iam.json call)
AWS SDK for Python (boto3) An error occurred (NotImplemented) when calling the ListAccountAliases operation: This operation is not yet emulated. Check docs/services/ for the support matrix.
AWS SDK for Go v2 iam-gen-probe/ListAccountAliases: ListAccountAliases params {}: call: expected the call to succeed, actual "operation error IAM: ListAccountAliases, https response error StatusCode: 501, RequestID: 65d5cacd-1daa-42d3-b296-2effbc3c09f0, api error NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Java 2.x iam-gen-probe/ListAccountAliases: ListAccountAliases params {}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix. (Service: Iam, Status Code: 501, Request ID: b751022c-d73c-4ea2-974c-85ebf84818a0) (SDK Attempt Count: 1)" (compat/model/scenarios/iam.json call)
AWS SDK for .NET iam-gen-probe/ListAccountAliases: ListAccountAliases params {}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Rust iam-gen-probe/ListAccountAliases: ListAccountAliases params {}: call: expected the call to succeed, actual "service error: unhandled error (NotImplemented): Error { code: \"NotImplemented\", message: \"This operation is not yet emulated. Check docs/services/ for the support matrix.\", aws_request_id: \"d29c9036-20cd-40ff-852c-05f68f87b3ad\" } (ServiceError(ServiceError { source: Unhandled(Unhandled { source: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"d29c9036-20cd-40ff-852c-05f68f87b3ad\"}) }, meta: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"d29c9036-20cd-40ff-852c-05f68f87b3ad\"}) } }), raw: Response { status: StatusCode(501), headers: {\"access-control-allow-headers\": \"Content-Type, Authorization\", \"access-control-allow-methods\": \"GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS\", \"access-control-allow-origin\": \"*\", \"access-control-expose-headers\": \"ETag, X-Amz-*, X-*\", \"content-length\": \"289\", \"content-type\": \"text/xml\", \"x-amzn-requestid\": \"d29c9036-20cd-40ff-852c-05f68f87b3ad\", \"x-emulator-unsupported\": \"true\", \"date\": \"Thu, 24 Sep 2026 08:16:43 GMT\"}, body: SdkBody { inner: Once(Some(b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?>\\n<ErrorResponse><Error><Type>Sender</Type><Code>NotImplemented</Code><Message>This operation is not yet emulated. Check docs/services/ for the support matrix.</Message></Error><RequestId>d29c9036-20cd-40ff-852c-05f68f87b3ad</RequestId></ErrorResponse>\")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo, aws_runtime::service_clock_skew::ResponseClockSkew} } } }))" (compat/model/scenarios/iam.json call)
| |||||||
| ListDelegationRequests | AWS SDK for JavaScript v3: Not emulated yet | AWS SDK for Python (boto3): Not emulated yet | AWS SDK for Go v2: Not emulated yet | AWS CLI v2: Not emulated yet | AWS SDK for Java 2.x: Not emulated yet | AWS SDK for .NET: Not emulated yet | AWS SDK for Rust: Not emulated yet |
Why 7 results do not pass · 7 on Overcast AWS SDK for JavaScript v3, AWS SDK for Python (boto3), AWS SDK for Go v2, AWS CLI v2, AWS SDK for Java 2.x, AWS SDK for .NET, AWS SDK for Rust: Not emulated yet JS, Python, Go, CLI, Java, .NET, Rust
Report this
Overcast returned 501 Not Implemented: the operation has no emulation yet. Messages (6)AWS SDK for JavaScript v3 NotImplemented: iam-gen-probe/ListDelegationRequests: ListDelegationRequests params={} — call: expected the call to succeed, actual NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix. (compat/model/scenarios/iam.json call)
AWS SDK for Python (boto3) An error occurred (NotImplemented) when calling the ListDelegationRequests operation: This operation is not yet emulated. Check docs/services/ for the support matrix.
AWS SDK for Go v2 iam-gen-probe/ListDelegationRequests: ListDelegationRequests params {}: call: expected the call to succeed, actual "operation error IAM: ListDelegationRequests, https response error StatusCode: 501, RequestID: 6a6f0bb7-9e03-4ea4-bc65-a4b51c5ee9f8, api error NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Java 2.x iam-gen-probe/ListDelegationRequests: ListDelegationRequests params {}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix. (Service: Iam, Status Code: 501, Request ID: f58616f9-ccec-44a2-9ec1-b1ca7bacaa07) (SDK Attempt Count: 1)" (compat/model/scenarios/iam.json call)
AWS SDK for .NET iam-gen-probe/ListDelegationRequests: ListDelegationRequests params {}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Rust iam-gen-probe/ListDelegationRequests: ListDelegationRequests params {}: call: expected the call to succeed, actual "service error: unhandled error (NotImplemented): Error { code: \"NotImplemented\", message: \"This operation is not yet emulated. Check docs/services/ for the support matrix.\", aws_request_id: \"11f2cdf0-14ec-4713-ad43-8bc1501adb8e\" } (ServiceError(ServiceError { source: Unhandled(Unhandled { source: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"11f2cdf0-14ec-4713-ad43-8bc1501adb8e\"}) }, meta: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"11f2cdf0-14ec-4713-ad43-8bc1501adb8e\"}) } }), raw: Response { status: StatusCode(501), headers: {\"access-control-allow-headers\": \"Content-Type, Authorization\", \"access-control-allow-methods\": \"GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS\", \"access-control-allow-origin\": \"*\", \"access-control-expose-headers\": \"ETag, X-Amz-*, X-*\", \"content-length\": \"289\", \"content-type\": \"text/xml\", \"x-amzn-requestid\": \"11f2cdf0-14ec-4713-ad43-8bc1501adb8e\", \"x-emulator-unsupported\": \"true\", \"date\": \"Thu, 24 Sep 2026 08:16:43 GMT\"}, body: SdkBody { inner: Once(Some(b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?>\\n<ErrorResponse><Error><Type>Sender</Type><Code>NotImplemented</Code><Message>This operation is not yet emulated. Check docs/services/ for the support matrix.</Message></Error><RequestId>11f2cdf0-14ec-4713-ad43-8bc1501adb8e</RequestId></ErrorResponse>\")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo, aws_runtime::service_clock_skew::ResponseClockSkew} } } }))" (compat/model/scenarios/iam.json call)
| |||||||
| ListEntitiesForPolicy | AWS SDK for JavaScript v3: Not emulated yet | AWS SDK for Python (boto3): Not emulated yet | AWS SDK for Go v2: Not emulated yet | AWS CLI v2: Not emulated yet | AWS SDK for Java 2.x: Not emulated yet | AWS SDK for .NET: Not emulated yet | AWS SDK for Rust: Not emulated yet |
Why 7 results do not pass · 7 on Overcast AWS SDK for JavaScript v3, AWS SDK for Python (boto3), AWS SDK for Go v2, AWS CLI v2, AWS SDK for Java 2.x, AWS SDK for .NET, AWS SDK for Rust: Not emulated yet JS, Python, Go, CLI, Java, .NET, Rust
Report this
Overcast returned 501 Not Implemented: the operation has no emulation yet. Messages (6)AWS SDK for JavaScript v3 NotImplemented: iam-gen-probe/ListEntitiesForPolicy: ListEntitiesForPolicy params={"PolicyArn":"arn:aws:iam::123456789012:policy/compat-scenario-nonexistent"} — call: expected the call to succeed, actual NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix. (compat/model/scenarios/iam.json call)
AWS SDK for Python (boto3) An error occurred (NotImplemented) when calling the ListEntitiesForPolicy operation: This operation is not yet emulated. Check docs/services/ for the support matrix.
AWS SDK for Go v2 iam-gen-probe/ListEntitiesForPolicy: ListEntitiesForPolicy params {"EntityFilter":"","PolicyArn":"arn:aws:iam::123456789012:policy/compat-scenario-nonexistent","PolicyUsageFilter":""}: call: expected the call to succeed, actual "operation error IAM: ListEntitiesForPolicy, https response error StatusCode: 501, RequestID: cf507139-ded8-4d3f-9636-b1142ab2d3fa, api error NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Java 2.x iam-gen-probe/ListEntitiesForPolicy: ListEntitiesForPolicy params {"PolicyArn":"arn:aws:iam::123456789012:policy/compat-scenario-nonexistent"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix. (Service: Iam, Status Code: 501, Request ID: 774f700f-db5d-40d7-900e-de960caee2e0) (SDK Attempt Count: 1)" (compat/model/scenarios/iam.json call)
AWS SDK for .NET iam-gen-probe/ListEntitiesForPolicy: ListEntitiesForPolicy params {"PolicyArn":"arn:aws:iam::123456789012:policy/compat-scenario-nonexistent"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Rust iam-gen-probe/ListEntitiesForPolicy: ListEntitiesForPolicy params {"PolicyArn":"arn:aws:iam::123456789012:policy/compat-scenario-nonexistent"}: call: expected the call to succeed, actual "service error: unhandled error (NotImplemented): Error { code: \"NotImplemented\", message: \"This operation is not yet emulated. Check docs/services/ for the support matrix.\", aws_request_id: \"72c5218a-801a-4b84-b1f0-62b12c90d87a\" } (ServiceError(ServiceError { source: Unhandled(Unhandled { source: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"72c5218a-801a-4b84-b1f0-62b12c90d87a\"}) }, meta: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"72c5218a-801a-4b84-b1f0-62b12c90d87a\"}) } }), raw: Response { status: StatusCode(501), headers: {\"access-control-allow-headers\": \"Content-Type, Authorization\", \"access-control-allow-methods\": \"GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS\", \"access-control-allow-origin\": \"*\", \"access-control-expose-headers\": \"ETag, X-Amz-*, X-*\", \"content-length\": \"289\", \"content-type\": \"text/xml\", \"x-amzn-requestid\": \"72c5218a-801a-4b84-b1f0-62b12c90d87a\", \"x-emulator-unsupported\": \"true\", \"date\": \"Thu, 24 Sep 2026 08:16:43 GMT\"}, body: SdkBody { inner: Once(Some(b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?>\\n<ErrorResponse><Error><Type>Sender</Type><Code>NotImplemented</Code><Message>This operation is not yet emulated. Check docs/services/ for the support matrix.</Message></Error><RequestId>72c5218a-801a-4b84-b1f0-62b12c90d87a</RequestId></ErrorResponse>\")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo, aws_runtime::service_clock_skew::ResponseClockSkew} } } }))" (compat/model/scenarios/iam.json call)
| |||||||
| ListMFADeviceTags | AWS SDK for JavaScript v3: Not emulated yet | AWS SDK for Python (boto3): Not emulated yet | AWS SDK for Go v2: Not emulated yet | AWS CLI v2: Not emulated yet | AWS SDK for Java 2.x: Not emulated yet | AWS SDK for .NET: Not emulated yet | AWS SDK for Rust: Not emulated yet |
Why 7 results do not pass · 7 on Overcast AWS SDK for JavaScript v3, AWS SDK for Python (boto3), AWS SDK for Go v2, AWS CLI v2, AWS SDK for Java 2.x, AWS SDK for .NET, AWS SDK for Rust: Not emulated yet JS, Python, Go, CLI, Java, .NET, Rust
Report this
Overcast returned 501 Not Implemented: the operation has no emulation yet. Messages (6)AWS SDK for JavaScript v3 NotImplemented: iam-gen-probe/ListMFADeviceTags: ListMFADeviceTags params={"SerialNumber":"arn:aws:iam::123456789012:mfa/compat-scenario-nonexistent"} — call: expected the call to succeed, actual NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix. (compat/model/scenarios/iam.json call)
AWS SDK for Python (boto3) An error occurred (NotImplemented) when calling the ListMFADeviceTags operation: This operation is not yet emulated. Check docs/services/ for the support matrix.
AWS SDK for Go v2 iam-gen-probe/ListMFADeviceTags: ListMFADeviceTags params {"SerialNumber":"arn:aws:iam::123456789012:mfa/compat-scenario-nonexistent"}: call: expected the call to succeed, actual "operation error IAM: ListMFADeviceTags, https response error StatusCode: 501, RequestID: e7edac17-b245-45e4-920f-dc476332461a, api error NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Java 2.x iam-gen-probe/ListMFADeviceTags: ListMFADeviceTags params {"SerialNumber":"arn:aws:iam::123456789012:mfa/compat-scenario-nonexistent"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix. (Service: Iam, Status Code: 501, Request ID: f67f6ff8-bafb-4693-9fb3-eeb537386348) (SDK Attempt Count: 1)" (compat/model/scenarios/iam.json call)
AWS SDK for .NET iam-gen-probe/ListMFADeviceTags: ListMFADeviceTags params {"SerialNumber":"arn:aws:iam::123456789012:mfa/compat-scenario-nonexistent"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Rust iam-gen-probe/ListMFADeviceTags: ListMFADeviceTags params {"SerialNumber":"arn:aws:iam::123456789012:mfa/compat-scenario-nonexistent"}: call: expected the call to succeed, actual "service error: unhandled error (NotImplemented): Error { code: \"NotImplemented\", message: \"This operation is not yet emulated. Check docs/services/ for the support matrix.\", aws_request_id: \"4ed3b284-3000-4154-9036-9b809cbb90a3\" } (ServiceError(ServiceError { source: Unhandled(Unhandled { source: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"4ed3b284-3000-4154-9036-9b809cbb90a3\"}) }, meta: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"4ed3b284-3000-4154-9036-9b809cbb90a3\"}) } }), raw: Response { status: StatusCode(501), headers: {\"access-control-allow-headers\": \"Content-Type, Authorization\", \"access-control-allow-methods\": \"GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS\", \"access-control-allow-origin\": \"*\", \"access-control-expose-headers\": \"ETag, X-Amz-*, X-*\", \"content-length\": \"289\", \"content-type\": \"text/xml\", \"x-amzn-requestid\": \"4ed3b284-3000-4154-9036-9b809cbb90a3\", \"x-emulator-unsupported\": \"true\", \"date\": \"Thu, 24 Sep 2026 08:16:43 GMT\"}, body: SdkBody { inner: Once(Some(b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?>\\n<ErrorResponse><Error><Type>Sender</Type><Code>NotImplemented</Code><Message>This operation is not yet emulated. Check docs/services/ for the support matrix.</Message></Error><RequestId>4ed3b284-3000-4154-9036-9b809cbb90a3</RequestId></ErrorResponse>\")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo, aws_runtime::service_clock_skew::ResponseClockSkew} } } }))" (compat/model/scenarios/iam.json call)
| |||||||
| ListMFADevices | AWS SDK for JavaScript v3: Not emulated yet | AWS SDK for Python (boto3): Not emulated yet | AWS SDK for Go v2: Not emulated yet | AWS CLI v2: Not emulated yet | AWS SDK for Java 2.x: Not emulated yet | AWS SDK for .NET: Not emulated yet | AWS SDK for Rust: Not emulated yet |
Why 7 results do not pass · 7 on Overcast AWS SDK for JavaScript v3, AWS SDK for Python (boto3), AWS SDK for Go v2, AWS CLI v2, AWS SDK for Java 2.x, AWS SDK for .NET, AWS SDK for Rust: Not emulated yet JS, Python, Go, CLI, Java, .NET, Rust
Report this
Overcast returned 501 Not Implemented: the operation has no emulation yet. Messages (6)AWS SDK for JavaScript v3 NotImplemented: iam-gen-probe/ListMFADevices: ListMFADevices params={} — call: expected the call to succeed, actual NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix. (compat/model/scenarios/iam.json call)
AWS SDK for Python (boto3) An error occurred (NotImplemented) when calling the ListMFADevices operation: This operation is not yet emulated. Check docs/services/ for the support matrix.
AWS SDK for Go v2 iam-gen-probe/ListMFADevices: ListMFADevices params {}: call: expected the call to succeed, actual "operation error IAM: ListMFADevices, https response error StatusCode: 501, RequestID: c7510f67-c90c-476b-b56c-0f4bcaf38086, api error NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Java 2.x iam-gen-probe/ListMFADevices: ListMFADevices params {}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix. (Service: Iam, Status Code: 501, Request ID: 78b0e871-ac63-464e-9914-da1120299606) (SDK Attempt Count: 1)" (compat/model/scenarios/iam.json call)
AWS SDK for .NET iam-gen-probe/ListMFADevices: ListMFADevices params {}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Rust iam-gen-probe/ListMFADevices: ListMFADevices params {}: call: expected the call to succeed, actual "service error: unhandled error (NotImplemented): Error { code: \"NotImplemented\", message: \"This operation is not yet emulated. Check docs/services/ for the support matrix.\", aws_request_id: \"22bd1281-9c74-4ba4-aa48-6ff5436d937c\" } (ServiceError(ServiceError { source: Unhandled(Unhandled { source: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"22bd1281-9c74-4ba4-aa48-6ff5436d937c\"}) }, meta: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"22bd1281-9c74-4ba4-aa48-6ff5436d937c\"}) } }), raw: Response { status: StatusCode(501), headers: {\"access-control-allow-headers\": \"Content-Type, Authorization\", \"access-control-allow-methods\": \"GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS\", \"access-control-allow-origin\": \"*\", \"access-control-expose-headers\": \"ETag, X-Amz-*, X-*\", \"content-length\": \"289\", \"content-type\": \"text/xml\", \"x-amzn-requestid\": \"22bd1281-9c74-4ba4-aa48-6ff5436d937c\", \"x-emulator-unsupported\": \"true\", \"date\": \"Thu, 24 Sep 2026 08:16:43 GMT\"}, body: SdkBody { inner: Once(Some(b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?>\\n<ErrorResponse><Error><Type>Sender</Type><Code>NotImplemented</Code><Message>This operation is not yet emulated. Check docs/services/ for the support matrix.</Message></Error><RequestId>22bd1281-9c74-4ba4-aa48-6ff5436d937c</RequestId></ErrorResponse>\")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo, aws_runtime::service_clock_skew::ResponseClockSkew} } } }))" (compat/model/scenarios/iam.json call)
| |||||||
| ListOpenIDConnectProviderTags | AWS SDK for JavaScript v3: Not emulated yet | AWS SDK for Python (boto3): Not emulated yet | AWS SDK for Go v2: Not emulated yet | AWS CLI v2: Not emulated yet | AWS SDK for Java 2.x: Not emulated yet | AWS SDK for .NET: Not emulated yet | AWS SDK for Rust: Not emulated yet |
Why 7 results do not pass · 7 on Overcast AWS SDK for JavaScript v3, AWS SDK for Python (boto3), AWS SDK for Go v2, AWS CLI v2, AWS SDK for Java 2.x, AWS SDK for .NET, AWS SDK for Rust: Not emulated yet JS, Python, Go, CLI, Java, .NET, Rust
Report this
Overcast returned 501 Not Implemented: the operation has no emulation yet. Messages (6)AWS SDK for JavaScript v3 NotImplemented: iam-gen-probe/ListOpenIDConnectProviderTags: ListOpenIDConnectProviderTags params={"OpenIDConnectProviderArn":"arn:aws:iam::123456789012:oidc-provider/compat-scenario-nonexistent.example.com"} — call: expected the call to succeed, actual NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix. (compat/model/scenarios/iam.json call)
AWS SDK for Python (boto3) An error occurred (NotImplemented) when calling the ListOpenIDConnectProviderTags operation: This operation is not yet emulated. Check docs/services/ for the support matrix.
AWS SDK for Go v2 iam-gen-probe/ListOpenIDConnectProviderTags: ListOpenIDConnectProviderTags params {"OpenIDConnectProviderArn":"arn:aws:iam::123456789012:oidc-provider/compat-scenario-nonexistent.example.com"}: call: expected the call to succeed, actual "operation error IAM: ListOpenIDConnectProviderTags, https response error StatusCode: 501, RequestID: 60acd7aa-c3f0-4d97-9e73-d77616ed0d45, api error NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Java 2.x iam-gen-probe/ListOpenIDConnectProviderTags: ListOpenIDConnectProviderTags params {"OpenIDConnectProviderArn":"arn:aws:iam::123456789012:oidc-provider/compat-scenario-nonexistent.example.com"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix. (Service: Iam, Status Code: 501, Request ID: 6eae821d-cd68-4101-8c5a-6b2c15a5564a) (SDK Attempt Count: 1)" (compat/model/scenarios/iam.json call)
AWS SDK for .NET iam-gen-probe/ListOpenIDConnectProviderTags: ListOpenIDConnectProviderTags params {"OpenIDConnectProviderArn":"arn:aws:iam::123456789012:oidc-provider/compat-scenario-nonexistent.example.com"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Rust iam-gen-probe/ListOpenIDConnectProviderTags: ListOpenIDConnectProviderTags params {"OpenIDConnectProviderArn":"arn:aws:iam::123456789012:oidc-provider/compat-scenario-nonexistent.example.com"}: call: expected the call to succeed, actual "service error: unhandled error (NotImplemented): Error { code: \"NotImplemented\", message: \"This operation is not yet emulated. Check docs/services/ for the support matrix.\", aws_request_id: \"5976ee87-0dcd-477b-8a73-f47768144e58\" } (ServiceError(ServiceError { source: Unhandled(Unhandled { source: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"5976ee87-0dcd-477b-8a73-f47768144e58\"}) }, meta: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"5976ee87-0dcd-477b-8a73-f47768144e58\"}) } }), raw: Response { status: StatusCode(501), headers: {\"access-control-allow-headers\": \"Content-Type, Authorization\", \"access-control-allow-methods\": \"GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS\", \"access-control-allow-origin\": \"*\", \"access-control-expose-headers\": \"ETag, X-Amz-*, X-*\", \"content-length\": \"289\", \"content-type\": \"text/xml\", \"x-amzn-requestid\": \"5976ee87-0dcd-477b-8a73-f47768144e58\", \"x-emulator-unsupported\": \"true\", \"date\": \"Thu, 24 Sep 2026 08:16:43 GMT\"}, body: SdkBody { inner: Once(Some(b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?>\\n<ErrorResponse><Error><Type>Sender</Type><Code>NotImplemented</Code><Message>This operation is not yet emulated. Check docs/services/ for the support matrix.</Message></Error><RequestId>5976ee87-0dcd-477b-8a73-f47768144e58</RequestId></ErrorResponse>\")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo, aws_runtime::service_clock_skew::ResponseClockSkew} } } }))" (compat/model/scenarios/iam.json call)
| |||||||
| ListOpenIDConnectProviders | AWS SDK for JavaScript v3: Not emulated yet | AWS SDK for Python (boto3): Not emulated yet | AWS SDK for Go v2: Not emulated yet | AWS CLI v2: Not emulated yet | AWS SDK for Java 2.x: Not emulated yet | AWS SDK for .NET: Not emulated yet | AWS SDK for Rust: Not emulated yet |
Why 7 results do not pass · 7 on Overcast AWS SDK for JavaScript v3, AWS SDK for Python (boto3), AWS SDK for Go v2, AWS CLI v2, AWS SDK for Java 2.x, AWS SDK for .NET, AWS SDK for Rust: Not emulated yet JS, Python, Go, CLI, Java, .NET, Rust
Report this
Overcast returned 501 Not Implemented: the operation has no emulation yet. Messages (6)AWS SDK for JavaScript v3 NotImplemented: iam-gen-probe/ListOpenIDConnectProviders: ListOpenIDConnectProviders params={} — call: expected the call to succeed, actual NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix. (compat/model/scenarios/iam.json call)
AWS SDK for Python (boto3) An error occurred (NotImplemented) when calling the ListOpenIDConnectProviders operation: This operation is not yet emulated. Check docs/services/ for the support matrix.
AWS SDK for Go v2 iam-gen-probe/ListOpenIDConnectProviders: ListOpenIDConnectProviders params {}: call: expected the call to succeed, actual "operation error IAM: ListOpenIDConnectProviders, https response error StatusCode: 501, RequestID: 402de853-e17c-4c4b-92cd-ebe1c4e0a4b6, api error NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Java 2.x iam-gen-probe/ListOpenIDConnectProviders: ListOpenIDConnectProviders params {}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix. (Service: Iam, Status Code: 501, Request ID: 358b50dd-0f32-43fb-967e-e90a9c506d75) (SDK Attempt Count: 1)" (compat/model/scenarios/iam.json call)
AWS SDK for .NET iam-gen-probe/ListOpenIDConnectProviders: ListOpenIDConnectProviders params {}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Rust iam-gen-probe/ListOpenIDConnectProviders: ListOpenIDConnectProviders params {}: call: expected the call to succeed, actual "service error: unhandled error (NotImplemented): Error { code: \"NotImplemented\", message: \"This operation is not yet emulated. Check docs/services/ for the support matrix.\", aws_request_id: \"3f82b1ef-cd9f-4951-967f-35f5d8ca4e07\" } (ServiceError(ServiceError { source: Unhandled(Unhandled { source: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"3f82b1ef-cd9f-4951-967f-35f5d8ca4e07\"}) }, meta: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"3f82b1ef-cd9f-4951-967f-35f5d8ca4e07\"}) } }), raw: Response { status: StatusCode(501), headers: {\"access-control-allow-headers\": \"Content-Type, Authorization\", \"access-control-allow-methods\": \"GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS\", \"access-control-allow-origin\": \"*\", \"access-control-expose-headers\": \"ETag, X-Amz-*, X-*\", \"content-length\": \"289\", \"content-type\": \"text/xml\", \"x-amzn-requestid\": \"3f82b1ef-cd9f-4951-967f-35f5d8ca4e07\", \"x-emulator-unsupported\": \"true\", \"date\": \"Thu, 24 Sep 2026 08:16:43 GMT\"}, body: SdkBody { inner: Once(Some(b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?>\\n<ErrorResponse><Error><Type>Sender</Type><Code>NotImplemented</Code><Message>This operation is not yet emulated. Check docs/services/ for the support matrix.</Message></Error><RequestId>3f82b1ef-cd9f-4951-967f-35f5d8ca4e07</RequestId></ErrorResponse>\")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo, aws_runtime::service_clock_skew::ResponseClockSkew} } } }))" (compat/model/scenarios/iam.json call)
| |||||||
| ListOrganizationsFeatures | AWS SDK for JavaScript v3: Not emulated yet | AWS SDK for Python (boto3): Not emulated yet | AWS SDK for Go v2: Not emulated yet | AWS CLI v2: Not emulated yet | AWS SDK for Java 2.x: Not emulated yet | AWS SDK for .NET: Not emulated yet | AWS SDK for Rust: Not emulated yet |
Why 7 results do not pass · 7 on Overcast AWS SDK for JavaScript v3, AWS SDK for Python (boto3), AWS SDK for Go v2, AWS CLI v2, AWS SDK for Java 2.x, AWS SDK for .NET, AWS SDK for Rust: Not emulated yet JS, Python, Go, CLI, Java, .NET, Rust
Report this
Overcast returned 501 Not Implemented: the operation has no emulation yet. Messages (6)AWS SDK for JavaScript v3 NotImplemented: iam-gen-probe/ListOrganizationsFeatures: ListOrganizationsFeatures params={} — call: expected the call to succeed, actual NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix. (compat/model/scenarios/iam.json call)
AWS SDK for Python (boto3) An error occurred (NotImplemented) when calling the ListOrganizationsFeatures operation: This operation is not yet emulated. Check docs/services/ for the support matrix.
AWS SDK for Go v2 iam-gen-probe/ListOrganizationsFeatures: ListOrganizationsFeatures params {}: call: expected the call to succeed, actual "operation error IAM: ListOrganizationsFeatures, https response error StatusCode: 501, RequestID: a5f49fd2-1d2e-49f7-8ace-0ed3e6e32098, api error NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Java 2.x iam-gen-probe/ListOrganizationsFeatures: ListOrganizationsFeatures params {}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix. (Service: Iam, Status Code: 501, Request ID: bca60b17-bdc1-4a33-8220-6d1a26ca7240) (SDK Attempt Count: 1)" (compat/model/scenarios/iam.json call)
AWS SDK for .NET iam-gen-probe/ListOrganizationsFeatures: ListOrganizationsFeatures params {}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Rust iam-gen-probe/ListOrganizationsFeatures: ListOrganizationsFeatures params {}: call: expected the call to succeed, actual "service error: unhandled error (NotImplemented): Error { code: \"NotImplemented\", message: \"This operation is not yet emulated. Check docs/services/ for the support matrix.\", aws_request_id: \"f71f27d7-5080-4b5b-b628-10004045962d\" } (ServiceError(ServiceError { source: Unhandled(Unhandled { source: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"f71f27d7-5080-4b5b-b628-10004045962d\"}) }, meta: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"f71f27d7-5080-4b5b-b628-10004045962d\"}) } }), raw: Response { status: StatusCode(501), headers: {\"access-control-allow-headers\": \"Content-Type, Authorization\", \"access-control-allow-methods\": \"GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS\", \"access-control-allow-origin\": \"*\", \"access-control-expose-headers\": \"ETag, X-Amz-*, X-*\", \"content-length\": \"289\", \"content-type\": \"text/xml\", \"x-amzn-requestid\": \"f71f27d7-5080-4b5b-b628-10004045962d\", \"x-emulator-unsupported\": \"true\", \"date\": \"Thu, 24 Sep 2026 08:16:43 GMT\"}, body: SdkBody { inner: Once(Some(b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?>\\n<ErrorResponse><Error><Type>Sender</Type><Code>NotImplemented</Code><Message>This operation is not yet emulated. Check docs/services/ for the support matrix.</Message></Error><RequestId>f71f27d7-5080-4b5b-b628-10004045962d</RequestId></ErrorResponse>\")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo, aws_runtime::service_clock_skew::ResponseClockSkew} } } }))" (compat/model/scenarios/iam.json call)
| |||||||
| ListPoliciesGrantingServiceAccess | AWS SDK for JavaScript v3: Not emulated yet | AWS SDK for Python (boto3): Not emulated yet | AWS SDK for Go v2: Not emulated yet | AWS CLI v2: Not emulated yet | AWS SDK for Java 2.x: Not emulated yet | AWS SDK for .NET: Not emulated yet | AWS SDK for Rust: Not emulated yet |
Why 7 results do not pass · 7 on Overcast AWS SDK for JavaScript v3, AWS SDK for Python (boto3), AWS SDK for Go v2, AWS CLI v2, AWS SDK for Java 2.x, AWS SDK for .NET, AWS SDK for Rust: Not emulated yet JS, Python, Go, CLI, Java, .NET, Rust
Report this
Overcast returned 501 Not Implemented: the operation has no emulation yet. Messages (6)AWS SDK for JavaScript v3 NotImplemented: iam-gen-probe/ListPoliciesGrantingServiceAccess: ListPoliciesGrantingServiceAccess params={"Arn":"arn:aws:iam::123456789012:user/compat-scenario-nonexistent","ServiceNamespaces":["s3"]} — call: expected the call to succeed, actual NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix. (compat/model/scenarios/iam.json call)
AWS SDK for Python (boto3) An error occurred (NotImplemented) when calling the ListPoliciesGrantingServiceAccess operation: This operation is not yet emulated. Check docs/services/ for the support matrix.
AWS SDK for Go v2 iam-gen-probe/ListPoliciesGrantingServiceAccess: ListPoliciesGrantingServiceAccess params {"Arn":"arn:aws:iam::123456789012:user/compat-scenario-nonexistent","ServiceNamespaces":["s3"]}: call: expected the call to succeed, actual "operation error IAM: ListPoliciesGrantingServiceAccess, https response error StatusCode: 501, RequestID: 470aebef-c457-44c8-9b67-4edb01068a0b, api error NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Java 2.x iam-gen-probe/ListPoliciesGrantingServiceAccess: ListPoliciesGrantingServiceAccess params {"Arn":"arn:aws:iam::123456789012:user/compat-scenario-nonexistent","ServiceNamespaces":["s3"]}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix. (Service: Iam, Status Code: 501, Request ID: 0579f2e0-1d6f-4558-81e8-5be1a9c08be9) (SDK Attempt Count: 1)" (compat/model/scenarios/iam.json call)
AWS SDK for .NET iam-gen-probe/ListPoliciesGrantingServiceAccess: ListPoliciesGrantingServiceAccess params {"Arn":"arn:aws:iam::123456789012:user/compat-scenario-nonexistent","ServiceNamespaces":["s3"]}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Rust iam-gen-probe/ListPoliciesGrantingServiceAccess: ListPoliciesGrantingServiceAccess params {"Arn":"arn:aws:iam::123456789012:user/compat-scenario-nonexistent","ServiceNamespaces":["s3"]}: call: expected the call to succeed, actual "service error: unhandled error (NotImplemented): Error { code: \"NotImplemented\", message: \"This operation is not yet emulated. Check docs/services/ for the support matrix.\", aws_request_id: \"e45f514b-997c-4991-813e-6277654a5bcd\" } (ServiceError(ServiceError { source: Unhandled(Unhandled { source: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"e45f514b-997c-4991-813e-6277654a5bcd\"}) }, meta: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"e45f514b-997c-4991-813e-6277654a5bcd\"}) } }), raw: Response { status: StatusCode(501), headers: {\"access-control-allow-headers\": \"Content-Type, Authorization\", \"access-control-allow-methods\": \"GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS\", \"access-control-allow-origin\": \"*\", \"access-control-expose-headers\": \"ETag, X-Amz-*, X-*\", \"content-length\": \"289\", \"content-type\": \"text/xml\", \"x-amzn-requestid\": \"e45f514b-997c-4991-813e-6277654a5bcd\", \"x-emulator-unsupported\": \"true\", \"date\": \"Thu, 24 Sep 2026 08:16:43 GMT\"}, body: SdkBody { inner: Once(Some(b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?>\\n<ErrorResponse><Error><Type>Sender</Type><Code>NotImplemented</Code><Message>This operation is not yet emulated. Check docs/services/ for the support matrix.</Message></Error><RequestId>e45f514b-997c-4991-813e-6277654a5bcd</RequestId></ErrorResponse>\")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo, aws_runtime::service_clock_skew::ResponseClockSkew} } } }))" (compat/model/scenarios/iam.json call)
| |||||||
| ListPolicyVersions | AWS SDK for JavaScript v3: Not emulated yet | AWS SDK for Python (boto3): Not emulated yet | AWS SDK for Go v2: Not emulated yet | AWS CLI v2: Not emulated yet | AWS SDK for Java 2.x: Not emulated yet | AWS SDK for .NET: Not emulated yet | AWS SDK for Rust: Not emulated yet |
Why 7 results do not pass · 7 on Overcast AWS SDK for JavaScript v3, AWS SDK for Python (boto3), AWS SDK for Go v2, AWS CLI v2, AWS SDK for Java 2.x, AWS SDK for .NET, AWS SDK for Rust: Not emulated yet JS, Python, Go, CLI, Java, .NET, Rust
Report this
Overcast returned 501 Not Implemented: the operation has no emulation yet. Messages (6)AWS SDK for JavaScript v3 NotImplemented: iam-gen-probe/ListPolicyVersions: ListPolicyVersions params={"PolicyArn":"arn:aws:iam::123456789012:policy/compat-scenario-nonexistent"} — call: expected the call to succeed, actual NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix. (compat/model/scenarios/iam.json call)
AWS SDK for Python (boto3) An error occurred (NotImplemented) when calling the ListPolicyVersions operation: This operation is not yet emulated. Check docs/services/ for the support matrix.
AWS SDK for Go v2 iam-gen-probe/ListPolicyVersions: ListPolicyVersions params {"PolicyArn":"arn:aws:iam::123456789012:policy/compat-scenario-nonexistent"}: call: expected the call to succeed, actual "operation error IAM: ListPolicyVersions, https response error StatusCode: 501, RequestID: 9428cb64-cf0d-45fa-bf50-dfd6df6f0b9a, api error NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Java 2.x iam-gen-probe/ListPolicyVersions: ListPolicyVersions params {"PolicyArn":"arn:aws:iam::123456789012:policy/compat-scenario-nonexistent"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix. (Service: Iam, Status Code: 501, Request ID: c085025f-50bb-449d-9f42-65af91b529ec) (SDK Attempt Count: 1)" (compat/model/scenarios/iam.json call)
AWS SDK for .NET iam-gen-probe/ListPolicyVersions: ListPolicyVersions params {"PolicyArn":"arn:aws:iam::123456789012:policy/compat-scenario-nonexistent"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Rust iam-gen-probe/ListPolicyVersions: ListPolicyVersions params {"PolicyArn":"arn:aws:iam::123456789012:policy/compat-scenario-nonexistent"}: call: expected the call to succeed, actual "service error: unhandled error (NotImplemented): Error { code: \"NotImplemented\", message: \"This operation is not yet emulated. Check docs/services/ for the support matrix.\", aws_request_id: \"fe1ff425-4f6a-4709-b564-cb488df3d444\" } (ServiceError(ServiceError { source: Unhandled(Unhandled { source: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"fe1ff425-4f6a-4709-b564-cb488df3d444\"}) }, meta: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"fe1ff425-4f6a-4709-b564-cb488df3d444\"}) } }), raw: Response { status: StatusCode(501), headers: {\"access-control-allow-headers\": \"Content-Type, Authorization\", \"access-control-allow-methods\": \"GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS\", \"access-control-allow-origin\": \"*\", \"access-control-expose-headers\": \"ETag, X-Amz-*, X-*\", \"content-length\": \"289\", \"content-type\": \"text/xml\", \"x-amzn-requestid\": \"fe1ff425-4f6a-4709-b564-cb488df3d444\", \"x-emulator-unsupported\": \"true\", \"date\": \"Thu, 24 Sep 2026 08:16:43 GMT\"}, body: SdkBody { inner: Once(Some(b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?>\\n<ErrorResponse><Error><Type>Sender</Type><Code>NotImplemented</Code><Message>This operation is not yet emulated. Check docs/services/ for the support matrix.</Message></Error><RequestId>fe1ff425-4f6a-4709-b564-cb488df3d444</RequestId></ErrorResponse>\")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo, aws_runtime::service_clock_skew::ResponseClockSkew} } } }))" (compat/model/scenarios/iam.json call)
| |||||||
| ListSAMLProviderTags | AWS SDK for JavaScript v3: Not emulated yet | AWS SDK for Python (boto3): Not emulated yet | AWS SDK for Go v2: Not emulated yet | AWS CLI v2: Not emulated yet | AWS SDK for Java 2.x: Not emulated yet | AWS SDK for .NET: Not emulated yet | AWS SDK for Rust: Not emulated yet |
Why 7 results do not pass · 7 on Overcast AWS SDK for JavaScript v3, AWS SDK for Python (boto3), AWS SDK for Go v2, AWS CLI v2, AWS SDK for Java 2.x, AWS SDK for .NET, AWS SDK for Rust: Not emulated yet JS, Python, Go, CLI, Java, .NET, Rust
Report this
Overcast returned 501 Not Implemented: the operation has no emulation yet. Messages (6)AWS SDK for JavaScript v3 NotImplemented: iam-gen-probe/ListSAMLProviderTags: ListSAMLProviderTags params={"SAMLProviderArn":"arn:aws:iam::123456789012:saml-provider/compat-scenario-nonexistent"} — call: expected the call to succeed, actual NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix. (compat/model/scenarios/iam.json call)
AWS SDK for Python (boto3) An error occurred (NotImplemented) when calling the ListSAMLProviderTags operation: This operation is not yet emulated. Check docs/services/ for the support matrix.
AWS SDK for Go v2 iam-gen-probe/ListSAMLProviderTags: ListSAMLProviderTags params {"SAMLProviderArn":"arn:aws:iam::123456789012:saml-provider/compat-scenario-nonexistent"}: call: expected the call to succeed, actual "operation error IAM: ListSAMLProviderTags, https response error StatusCode: 501, RequestID: f64e54d6-353e-4814-9145-53889e73058b, api error NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Java 2.x iam-gen-probe/ListSAMLProviderTags: ListSAMLProviderTags params {"SAMLProviderArn":"arn:aws:iam::123456789012:saml-provider/compat-scenario-nonexistent"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix. (Service: Iam, Status Code: 501, Request ID: da4fc974-30d0-43d2-a02e-f8d717f02243) (SDK Attempt Count: 1)" (compat/model/scenarios/iam.json call)
AWS SDK for .NET iam-gen-probe/ListSAMLProviderTags: ListSAMLProviderTags params {"SAMLProviderArn":"arn:aws:iam::123456789012:saml-provider/compat-scenario-nonexistent"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Rust iam-gen-probe/ListSAMLProviderTags: ListSAMLProviderTags params {"SAMLProviderArn":"arn:aws:iam::123456789012:saml-provider/compat-scenario-nonexistent"}: call: expected the call to succeed, actual "service error: unhandled error (NotImplemented): Error { code: \"NotImplemented\", message: \"This operation is not yet emulated. Check docs/services/ for the support matrix.\", aws_request_id: \"bce0e6b9-edfd-4a45-869b-22d7d6bf6167\" } (ServiceError(ServiceError { source: Unhandled(Unhandled { source: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"bce0e6b9-edfd-4a45-869b-22d7d6bf6167\"}) }, meta: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"bce0e6b9-edfd-4a45-869b-22d7d6bf6167\"}) } }), raw: Response { status: StatusCode(501), headers: {\"access-control-allow-headers\": \"Content-Type, Authorization\", \"access-control-allow-methods\": \"GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS\", \"access-control-allow-origin\": \"*\", \"access-control-expose-headers\": \"ETag, X-Amz-*, X-*\", \"content-length\": \"289\", \"content-type\": \"text/xml\", \"x-amzn-requestid\": \"bce0e6b9-edfd-4a45-869b-22d7d6bf6167\", \"x-emulator-unsupported\": \"true\", \"date\": \"Thu, 24 Sep 2026 08:16:43 GMT\"}, body: SdkBody { inner: Once(Some(b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?>\\n<ErrorResponse><Error><Type>Sender</Type><Code>NotImplemented</Code><Message>This operation is not yet emulated. Check docs/services/ for the support matrix.</Message></Error><RequestId>bce0e6b9-edfd-4a45-869b-22d7d6bf6167</RequestId></ErrorResponse>\")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo, aws_runtime::service_clock_skew::ResponseClockSkew} } } }))" (compat/model/scenarios/iam.json call)
| |||||||
| ListSAMLProviders | AWS SDK for JavaScript v3: Not emulated yet | AWS SDK for Python (boto3): Not emulated yet | AWS SDK for Go v2: Not emulated yet | AWS CLI v2: Not emulated yet | AWS SDK for Java 2.x: Not emulated yet | AWS SDK for .NET: Not emulated yet | AWS SDK for Rust: Not emulated yet |
Why 7 results do not pass · 7 on Overcast AWS SDK for JavaScript v3, AWS SDK for Python (boto3), AWS SDK for Go v2, AWS CLI v2, AWS SDK for Java 2.x, AWS SDK for .NET, AWS SDK for Rust: Not emulated yet JS, Python, Go, CLI, Java, .NET, Rust
Report this
Overcast returned 501 Not Implemented: the operation has no emulation yet. Messages (6)AWS SDK for JavaScript v3 NotImplemented: iam-gen-probe/ListSAMLProviders: ListSAMLProviders params={} — call: expected the call to succeed, actual NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix. (compat/model/scenarios/iam.json call)
AWS SDK for Python (boto3) An error occurred (NotImplemented) when calling the ListSAMLProviders operation: This operation is not yet emulated. Check docs/services/ for the support matrix.
AWS SDK for Go v2 iam-gen-probe/ListSAMLProviders: ListSAMLProviders params {}: call: expected the call to succeed, actual "operation error IAM: ListSAMLProviders, https response error StatusCode: 501, RequestID: 6e639e46-bf35-4d91-8286-8837027517c9, api error NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Java 2.x iam-gen-probe/ListSAMLProviders: ListSAMLProviders params {}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix. (Service: Iam, Status Code: 501, Request ID: e6037781-a92d-4b41-b7ae-d7d9e96594dc) (SDK Attempt Count: 1)" (compat/model/scenarios/iam.json call)
AWS SDK for .NET iam-gen-probe/ListSAMLProviders: ListSAMLProviders params {}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Rust iam-gen-probe/ListSAMLProviders: ListSAMLProviders params {}: call: expected the call to succeed, actual "service error: unhandled error (NotImplemented): Error { code: \"NotImplemented\", message: \"This operation is not yet emulated. Check docs/services/ for the support matrix.\", aws_request_id: \"77dcdb3e-9725-4bc5-8b76-6d6249bd75db\" } (ServiceError(ServiceError { source: Unhandled(Unhandled { source: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"77dcdb3e-9725-4bc5-8b76-6d6249bd75db\"}) }, meta: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"77dcdb3e-9725-4bc5-8b76-6d6249bd75db\"}) } }), raw: Response { status: StatusCode(501), headers: {\"access-control-allow-headers\": \"Content-Type, Authorization\", \"access-control-allow-methods\": \"GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS\", \"access-control-allow-origin\": \"*\", \"access-control-expose-headers\": \"ETag, X-Amz-*, X-*\", \"content-length\": \"289\", \"content-type\": \"text/xml\", \"x-amzn-requestid\": \"77dcdb3e-9725-4bc5-8b76-6d6249bd75db\", \"x-emulator-unsupported\": \"true\", \"date\": \"Thu, 24 Sep 2026 08:16:43 GMT\"}, body: SdkBody { inner: Once(Some(b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?>\\n<ErrorResponse><Error><Type>Sender</Type><Code>NotImplemented</Code><Message>This operation is not yet emulated. Check docs/services/ for the support matrix.</Message></Error><RequestId>77dcdb3e-9725-4bc5-8b76-6d6249bd75db</RequestId></ErrorResponse>\")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo, aws_runtime::service_clock_skew::ResponseClockSkew} } } }))" (compat/model/scenarios/iam.json call)
| |||||||
| ListSSHPublicKeys | AWS SDK for JavaScript v3: Not emulated yet | AWS SDK for Python (boto3): Not emulated yet | AWS SDK for Go v2: Not emulated yet | AWS CLI v2: Not emulated yet | AWS SDK for Java 2.x: Not emulated yet | AWS SDK for .NET: Not emulated yet | AWS SDK for Rust: Not emulated yet |
Why 7 results do not pass · 7 on Overcast AWS SDK for JavaScript v3, AWS SDK for Python (boto3), AWS SDK for Go v2, AWS CLI v2, AWS SDK for Java 2.x, AWS SDK for .NET, AWS SDK for Rust: Not emulated yet JS, Python, Go, CLI, Java, .NET, Rust
Report this
Overcast returned 501 Not Implemented: the operation has no emulation yet. Messages (6)AWS SDK for JavaScript v3 NotImplemented: iam-gen-probe/ListSSHPublicKeys: ListSSHPublicKeys params={} — call: expected the call to succeed, actual NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix. (compat/model/scenarios/iam.json call)
AWS SDK for Python (boto3) An error occurred (NotImplemented) when calling the ListSSHPublicKeys operation: This operation is not yet emulated. Check docs/services/ for the support matrix.
AWS SDK for Go v2 iam-gen-probe/ListSSHPublicKeys: ListSSHPublicKeys params {}: call: expected the call to succeed, actual "operation error IAM: ListSSHPublicKeys, https response error StatusCode: 501, RequestID: ba71b60c-8717-4d6d-a4fc-50fb954efa49, api error NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Java 2.x iam-gen-probe/ListSSHPublicKeys: ListSSHPublicKeys params {}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix. (Service: Iam, Status Code: 501, Request ID: 9e81a869-4bb6-4006-a994-c24f87c2155e) (SDK Attempt Count: 1)" (compat/model/scenarios/iam.json call)
AWS SDK for .NET iam-gen-probe/ListSSHPublicKeys: ListSSHPublicKeys params {}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Rust iam-gen-probe/ListSSHPublicKeys: ListSSHPublicKeys params {}: call: expected the call to succeed, actual "service error: unhandled error (NotImplemented): Error { code: \"NotImplemented\", message: \"This operation is not yet emulated. Check docs/services/ for the support matrix.\", aws_request_id: \"ac6685d4-8f07-4542-bb8c-fcb2be61c9da\" } (ServiceError(ServiceError { source: Unhandled(Unhandled { source: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"ac6685d4-8f07-4542-bb8c-fcb2be61c9da\"}) }, meta: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"ac6685d4-8f07-4542-bb8c-fcb2be61c9da\"}) } }), raw: Response { status: StatusCode(501), headers: {\"access-control-allow-headers\": \"Content-Type, Authorization\", \"access-control-allow-methods\": \"GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS\", \"access-control-allow-origin\": \"*\", \"access-control-expose-headers\": \"ETag, X-Amz-*, X-*\", \"content-length\": \"289\", \"content-type\": \"text/xml\", \"x-amzn-requestid\": \"ac6685d4-8f07-4542-bb8c-fcb2be61c9da\", \"x-emulator-unsupported\": \"true\", \"date\": \"Thu, 24 Sep 2026 08:16:43 GMT\"}, body: SdkBody { inner: Once(Some(b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?>\\n<ErrorResponse><Error><Type>Sender</Type><Code>NotImplemented</Code><Message>This operation is not yet emulated. Check docs/services/ for the support matrix.</Message></Error><RequestId>ac6685d4-8f07-4542-bb8c-fcb2be61c9da</RequestId></ErrorResponse>\")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo, aws_runtime::service_clock_skew::ResponseClockSkew} } } }))" (compat/model/scenarios/iam.json call)
| |||||||
| ListServerCertificateTags | AWS SDK for JavaScript v3: Not emulated yet | AWS SDK for Python (boto3): Not emulated yet | AWS SDK for Go v2: Not emulated yet | AWS CLI v2: Not emulated yet | AWS SDK for Java 2.x: Not emulated yet | AWS SDK for .NET: Not emulated yet | AWS SDK for Rust: Not emulated yet |
Why 7 results do not pass · 7 on Overcast AWS SDK for JavaScript v3, AWS SDK for Python (boto3), AWS SDK for Go v2, AWS CLI v2, AWS SDK for Java 2.x, AWS SDK for .NET, AWS SDK for Rust: Not emulated yet JS, Python, Go, CLI, Java, .NET, Rust
Report this
Overcast returned 501 Not Implemented: the operation has no emulation yet. Messages (6)AWS SDK for JavaScript v3 NotImplemented: iam-gen-probe/ListServerCertificateTags: ListServerCertificateTags params={"ServerCertificateName":"compat-scenario-nonexistent"} — call: expected the call to succeed, actual NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix. (compat/model/scenarios/iam.json call)
AWS SDK for Python (boto3) An error occurred (NotImplemented) when calling the ListServerCertificateTags operation: This operation is not yet emulated. Check docs/services/ for the support matrix.
AWS SDK for Go v2 iam-gen-probe/ListServerCertificateTags: ListServerCertificateTags params {"ServerCertificateName":"compat-scenario-nonexistent"}: call: expected the call to succeed, actual "operation error IAM: ListServerCertificateTags, https response error StatusCode: 501, RequestID: 3eff78cc-c35f-4a20-a74c-1de92b0fac0d, api error NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Java 2.x iam-gen-probe/ListServerCertificateTags: ListServerCertificateTags params {"ServerCertificateName":"compat-scenario-nonexistent"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix. (Service: Iam, Status Code: 501, Request ID: 873cc36d-c26b-4d41-8757-b5de559d212d) (SDK Attempt Count: 1)" (compat/model/scenarios/iam.json call)
AWS SDK for .NET iam-gen-probe/ListServerCertificateTags: ListServerCertificateTags params {"ServerCertificateName":"compat-scenario-nonexistent"}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Rust iam-gen-probe/ListServerCertificateTags: ListServerCertificateTags params {"ServerCertificateName":"compat-scenario-nonexistent"}: call: expected the call to succeed, actual "service error: unhandled error (NotImplemented): Error { code: \"NotImplemented\", message: \"This operation is not yet emulated. Check docs/services/ for the support matrix.\", aws_request_id: \"5385c57f-eb04-4760-995a-872ff7771f0b\" } (ServiceError(ServiceError { source: Unhandled(Unhandled { source: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"5385c57f-eb04-4760-995a-872ff7771f0b\"}) }, meta: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"5385c57f-eb04-4760-995a-872ff7771f0b\"}) } }), raw: Response { status: StatusCode(501), headers: {\"access-control-allow-headers\": \"Content-Type, Authorization\", \"access-control-allow-methods\": \"GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS\", \"access-control-allow-origin\": \"*\", \"access-control-expose-headers\": \"ETag, X-Amz-*, X-*\", \"content-length\": \"289\", \"content-type\": \"text/xml\", \"x-amzn-requestid\": \"5385c57f-eb04-4760-995a-872ff7771f0b\", \"x-emulator-unsupported\": \"true\", \"date\": \"Thu, 24 Sep 2026 08:16:43 GMT\"}, body: SdkBody { inner: Once(Some(b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?>\\n<ErrorResponse><Error><Type>Sender</Type><Code>NotImplemented</Code><Message>This operation is not yet emulated. Check docs/services/ for the support matrix.</Message></Error><RequestId>5385c57f-eb04-4760-995a-872ff7771f0b</RequestId></ErrorResponse>\")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo, aws_runtime::service_clock_skew::ResponseClockSkew} } } }))" (compat/model/scenarios/iam.json call)
| |||||||
| ListServerCertificates | AWS SDK for JavaScript v3: Not emulated yet | AWS SDK for Python (boto3): Not emulated yet | AWS SDK for Go v2: Not emulated yet | AWS CLI v2: Not emulated yet | AWS SDK for Java 2.x: Not emulated yet | AWS SDK for .NET: Not emulated yet | AWS SDK for Rust: Not emulated yet |
Why 7 results do not pass · 7 on Overcast AWS SDK for JavaScript v3, AWS SDK for Python (boto3), AWS SDK for Go v2, AWS CLI v2, AWS SDK for Java 2.x, AWS SDK for .NET, AWS SDK for Rust: Not emulated yet JS, Python, Go, CLI, Java, .NET, Rust
Report this
Overcast returned 501 Not Implemented: the operation has no emulation yet. Messages (6)AWS SDK for JavaScript v3 NotImplemented: iam-gen-probe/ListServerCertificates: ListServerCertificates params={} — call: expected the call to succeed, actual NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix. (compat/model/scenarios/iam.json call)
AWS SDK for Python (boto3) An error occurred (NotImplemented) when calling the ListServerCertificates operation: This operation is not yet emulated. Check docs/services/ for the support matrix.
AWS SDK for Go v2 iam-gen-probe/ListServerCertificates: ListServerCertificates params {}: call: expected the call to succeed, actual "operation error IAM: ListServerCertificates, https response error StatusCode: 501, RequestID: 375efd8d-0984-4949-9150-327e5ba05f3d, api error NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Java 2.x iam-gen-probe/ListServerCertificates: ListServerCertificates params {}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix. (Service: Iam, Status Code: 501, Request ID: 035fa3f3-1e27-4ac7-be9b-2406f015cf85) (SDK Attempt Count: 1)" (compat/model/scenarios/iam.json call)
AWS SDK for .NET iam-gen-probe/ListServerCertificates: ListServerCertificates params {}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Rust iam-gen-probe/ListServerCertificates: ListServerCertificates params {}: call: expected the call to succeed, actual "service error: unhandled error (NotImplemented): Error { code: \"NotImplemented\", message: \"This operation is not yet emulated. Check docs/services/ for the support matrix.\", aws_request_id: \"e39a727b-0456-4eee-800a-c8c2721dc8e4\" } (ServiceError(ServiceError { source: Unhandled(Unhandled { source: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"e39a727b-0456-4eee-800a-c8c2721dc8e4\"}) }, meta: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"e39a727b-0456-4eee-800a-c8c2721dc8e4\"}) } }), raw: Response { status: StatusCode(501), headers: {\"access-control-allow-headers\": \"Content-Type, Authorization\", \"access-control-allow-methods\": \"GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS\", \"access-control-allow-origin\": \"*\", \"access-control-expose-headers\": \"ETag, X-Amz-*, X-*\", \"content-length\": \"289\", \"content-type\": \"text/xml\", \"x-amzn-requestid\": \"e39a727b-0456-4eee-800a-c8c2721dc8e4\", \"x-emulator-unsupported\": \"true\", \"date\": \"Thu, 24 Sep 2026 08:16:43 GMT\"}, body: SdkBody { inner: Once(Some(b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?>\\n<ErrorResponse><Error><Type>Sender</Type><Code>NotImplemented</Code><Message>This operation is not yet emulated. Check docs/services/ for the support matrix.</Message></Error><RequestId>e39a727b-0456-4eee-800a-c8c2721dc8e4</RequestId></ErrorResponse>\")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo, aws_runtime::service_clock_skew::ResponseClockSkew} } } }))" (compat/model/scenarios/iam.json call)
| |||||||
| ListServiceSpecificCredentials | AWS SDK for JavaScript v3: Not emulated yet | AWS SDK for Python (boto3): Not emulated yet | AWS SDK for Go v2: Not emulated yet | AWS CLI v2: Not emulated yet | AWS SDK for Java 2.x: Not emulated yet | AWS SDK for .NET: Not emulated yet | AWS SDK for Rust: Not emulated yet |
Why 7 results do not pass · 7 on Overcast AWS SDK for JavaScript v3, AWS SDK for Python (boto3), AWS SDK for Go v2, AWS CLI v2, AWS SDK for Java 2.x, AWS SDK for .NET, AWS SDK for Rust: Not emulated yet JS, Python, Go, CLI, Java, .NET, Rust
Report this
Overcast returned 501 Not Implemented: the operation has no emulation yet. Messages (6)AWS SDK for JavaScript v3 NotImplemented: iam-gen-probe/ListServiceSpecificCredentials: ListServiceSpecificCredentials params={} — call: expected the call to succeed, actual NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix. (compat/model/scenarios/iam.json call)
AWS SDK for Python (boto3) An error occurred (NotImplemented) when calling the ListServiceSpecificCredentials operation: This operation is not yet emulated. Check docs/services/ for the support matrix.
AWS SDK for Go v2 iam-gen-probe/ListServiceSpecificCredentials: ListServiceSpecificCredentials params {}: call: expected the call to succeed, actual "operation error IAM: ListServiceSpecificCredentials, https response error StatusCode: 501, RequestID: 19b853ef-3e17-414b-ba40-5f2742bd674a, api error NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Java 2.x iam-gen-probe/ListServiceSpecificCredentials: ListServiceSpecificCredentials params {}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix. (Service: Iam, Status Code: 501, Request ID: aa51dd0e-8370-4abe-8446-5878bb9be727) (SDK Attempt Count: 1)" (compat/model/scenarios/iam.json call)
AWS SDK for .NET iam-gen-probe/ListServiceSpecificCredentials: ListServiceSpecificCredentials params {}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Rust iam-gen-probe/ListServiceSpecificCredentials: ListServiceSpecificCredentials params {}: call: expected the call to succeed, actual "service error: unhandled error (NotImplemented): Error { code: \"NotImplemented\", message: \"This operation is not yet emulated. Check docs/services/ for the support matrix.\", aws_request_id: \"ad985c54-0e1f-4f85-973c-f5e2e08b571c\" } (ServiceError(ServiceError { source: Unhandled(Unhandled { source: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"ad985c54-0e1f-4f85-973c-f5e2e08b571c\"}) }, meta: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"ad985c54-0e1f-4f85-973c-f5e2e08b571c\"}) } }), raw: Response { status: StatusCode(501), headers: {\"access-control-allow-headers\": \"Content-Type, Authorization\", \"access-control-allow-methods\": \"GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS\", \"access-control-allow-origin\": \"*\", \"access-control-expose-headers\": \"ETag, X-Amz-*, X-*\", \"content-length\": \"289\", \"content-type\": \"text/xml\", \"x-amzn-requestid\": \"ad985c54-0e1f-4f85-973c-f5e2e08b571c\", \"x-emulator-unsupported\": \"true\", \"date\": \"Thu, 24 Sep 2026 08:16:43 GMT\"}, body: SdkBody { inner: Once(Some(b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?>\\n<ErrorResponse><Error><Type>Sender</Type><Code>NotImplemented</Code><Message>This operation is not yet emulated. Check docs/services/ for the support matrix.</Message></Error><RequestId>ad985c54-0e1f-4f85-973c-f5e2e08b571c</RequestId></ErrorResponse>\")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo, aws_runtime::service_clock_skew::ResponseClockSkew} } } }))" (compat/model/scenarios/iam.json call)
| |||||||
| ListSigningCertificates | AWS SDK for JavaScript v3: Not emulated yet | AWS SDK for Python (boto3): Not emulated yet | AWS SDK for Go v2: Not emulated yet | AWS CLI v2: Not emulated yet | AWS SDK for Java 2.x: Not emulated yet | AWS SDK for .NET: Not emulated yet | AWS SDK for Rust: Not emulated yet |
Why 7 results do not pass · 7 on Overcast AWS SDK for JavaScript v3, AWS SDK for Python (boto3), AWS SDK for Go v2, AWS CLI v2, AWS SDK for Java 2.x, AWS SDK for .NET, AWS SDK for Rust: Not emulated yet JS, Python, Go, CLI, Java, .NET, Rust
Report this
Overcast returned 501 Not Implemented: the operation has no emulation yet. Messages (6)AWS SDK for JavaScript v3 NotImplemented: iam-gen-probe/ListSigningCertificates: ListSigningCertificates params={} — call: expected the call to succeed, actual NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix. (compat/model/scenarios/iam.json call)
AWS SDK for Python (boto3) An error occurred (NotImplemented) when calling the ListSigningCertificates operation: This operation is not yet emulated. Check docs/services/ for the support matrix.
AWS SDK for Go v2 iam-gen-probe/ListSigningCertificates: ListSigningCertificates params {}: call: expected the call to succeed, actual "operation error IAM: ListSigningCertificates, https response error StatusCode: 501, RequestID: a699d08b-ce4d-47c7-bdc0-770a1e3b50a3, api error NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Java 2.x iam-gen-probe/ListSigningCertificates: ListSigningCertificates params {}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix. (Service: Iam, Status Code: 501, Request ID: b9d0ccce-8bac-4c10-b0df-28882dd33aeb) (SDK Attempt Count: 1)" (compat/model/scenarios/iam.json call)
AWS SDK for .NET iam-gen-probe/ListSigningCertificates: ListSigningCertificates params {}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Rust iam-gen-probe/ListSigningCertificates: ListSigningCertificates params {}: call: expected the call to succeed, actual "service error: unhandled error (NotImplemented): Error { code: \"NotImplemented\", message: \"This operation is not yet emulated. Check docs/services/ for the support matrix.\", aws_request_id: \"1541ba42-7455-43f6-85f1-219088590519\" } (ServiceError(ServiceError { source: Unhandled(Unhandled { source: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"1541ba42-7455-43f6-85f1-219088590519\"}) }, meta: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"1541ba42-7455-43f6-85f1-219088590519\"}) } }), raw: Response { status: StatusCode(501), headers: {\"access-control-allow-headers\": \"Content-Type, Authorization\", \"access-control-allow-methods\": \"GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS\", \"access-control-allow-origin\": \"*\", \"access-control-expose-headers\": \"ETag, X-Amz-*, X-*\", \"content-length\": \"289\", \"content-type\": \"text/xml\", \"x-amzn-requestid\": \"1541ba42-7455-43f6-85f1-219088590519\", \"x-emulator-unsupported\": \"true\", \"date\": \"Thu, 24 Sep 2026 08:16:43 GMT\"}, body: SdkBody { inner: Once(Some(b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?>\\n<ErrorResponse><Error><Type>Sender</Type><Code>NotImplemented</Code><Message>This operation is not yet emulated. Check docs/services/ for the support matrix.</Message></Error><RequestId>1541ba42-7455-43f6-85f1-219088590519</RequestId></ErrorResponse>\")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo, aws_runtime::service_clock_skew::ResponseClockSkew} } } }))" (compat/model/scenarios/iam.json call)
| |||||||
| ListVirtualMFADevices | AWS SDK for JavaScript v3: Not emulated yet | AWS SDK for Python (boto3): Not emulated yet | AWS SDK for Go v2: Not emulated yet | AWS CLI v2: Not emulated yet | AWS SDK for Java 2.x: Not emulated yet | AWS SDK for .NET: Not emulated yet | AWS SDK for Rust: Not emulated yet |
Why 7 results do not pass · 7 on Overcast AWS SDK for JavaScript v3, AWS SDK for Python (boto3), AWS SDK for Go v2, AWS CLI v2, AWS SDK for Java 2.x, AWS SDK for .NET, AWS SDK for Rust: Not emulated yet JS, Python, Go, CLI, Java, .NET, Rust
Report this
Overcast returned 501 Not Implemented: the operation has no emulation yet. Messages (6)AWS SDK for JavaScript v3 NotImplemented: iam-gen-probe/ListVirtualMFADevices: ListVirtualMFADevices params={} — call: expected the call to succeed, actual NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix. (compat/model/scenarios/iam.json call)
AWS SDK for Python (boto3) An error occurred (NotImplemented) when calling the ListVirtualMFADevices operation: This operation is not yet emulated. Check docs/services/ for the support matrix.
AWS SDK for Go v2 iam-gen-probe/ListVirtualMFADevices: ListVirtualMFADevices params {"AssignmentStatus":""}: call: expected the call to succeed, actual "operation error IAM: ListVirtualMFADevices, https response error StatusCode: 501, RequestID: df96115a-1b01-49b8-a653-fb9a11838903, api error NotImplemented: This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Java 2.x iam-gen-probe/ListVirtualMFADevices: ListVirtualMFADevices params {}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix. (Service: Iam, Status Code: 501, Request ID: dc830e71-c41e-4eac-bc65-1374904266b0) (SDK Attempt Count: 1)" (compat/model/scenarios/iam.json call)
AWS SDK for .NET iam-gen-probe/ListVirtualMFADevices: ListVirtualMFADevices params {}: call: expected the call to succeed, actual "This operation is not yet emulated. Check docs/services/ for the support matrix." (compat/model/scenarios/iam.json call)
AWS SDK for Rust iam-gen-probe/ListVirtualMFADevices: ListVirtualMFADevices params {}: call: expected the call to succeed, actual "service error: unhandled error (NotImplemented): Error { code: \"NotImplemented\", message: \"This operation is not yet emulated. Check docs/services/ for the support matrix.\", aws_request_id: \"f6b9770f-47ad-43ef-9b67-836b0a8dcd8e\" } (ServiceError(ServiceError { source: Unhandled(Unhandled { source: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"f6b9770f-47ad-43ef-9b67-836b0a8dcd8e\"}) }, meta: ErrorMetadata { code: Some(\"NotImplemented\"), message: Some(\"This operation is not yet emulated. Check docs/services/ for the support matrix.\"), extras: Some({\"aws_request_id\": \"f6b9770f-47ad-43ef-9b67-836b0a8dcd8e\"}) } }), raw: Response { status: StatusCode(501), headers: {\"access-control-allow-headers\": \"Content-Type, Authorization\", \"access-control-allow-methods\": \"GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS\", \"access-control-allow-origin\": \"*\", \"access-control-expose-headers\": \"ETag, X-Amz-*, X-*\", \"content-length\": \"289\", \"content-type\": \"text/xml\", \"x-amzn-requestid\": \"f6b9770f-47ad-43ef-9b67-836b0a8dcd8e\", \"x-emulator-unsupported\": \"true\", \"date\": \"Thu, 24 Sep 2026 08:16:43 GMT\"}, body: SdkBody { inner: Once(Some(b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?>\\n<ErrorResponse><Error><Type>Sender</Type><Code>NotImplemented</Code><Message>This operation is not yet emulated. Check docs/services/ for the support matrix.</Message></Error><RequestId>f6b9770f-47ad-43ef-9b67-836b0a8dcd8e</RequestId></ErrorResponse>\")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo, aws_runtime::service_clock_skew::ResponseClockSkew} } } }))" (compat/model/scenarios/iam.json call)
| |||||||
iam-gen-role generated from the AWS model soaking
| Test | JS | Python | Go | CLI | Java | .NET | Rust |
|---|---|---|---|---|---|---|---|
| CreateRole | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| GetRole | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| UpdateRole | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| TagRole | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| ListRoleTags | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| UntagRole | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| UpdateAssumeRolePolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| PutRolePolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| GetRolePolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| ListRolePolicies | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| SimulatePrincipalPolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| DeleteRolePolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| AttachRolePolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| ListAttachedRolePolicies | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| DetachRolePolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| PutRolePermissionsBoundary | AWS SDK for JavaScript v3: New test, still soaking | AWS SDK for Python (boto3): New test, still soaking | AWS SDK for Go v2: New test, still soaking | AWS CLI v2: New test, still soaking | AWS SDK for Java 2.x: New test, still soaking | AWS SDK for .NET: New test, still soaking | AWS SDK for Rust: New test, still soaking |
Why 7 results do not passA test generated from the AWS model that has not yet run cleanly enough times to count.
Message ScenarioFailure: eventually gave up after 6 attempt(s) 500ms apart; last failure: iam-gen-role/PutRolePermissionsBoundary: GetRole params={"RoleName":"oc-207c52a7-nj-iam-gen-role-r"} — readback at $.Role.PermissionsBoundary.PermissionsBoundaryType: expected "PermissionsBoundaryPolicy", actual "Policy" (compat/model/scenarios/iam.json assert[0].assert)
AWS SDK for Python (boto3), AWS SDK for Go v2, AWS CLI v2, AWS SDK for Java 2.x, AWS SDK for .NET, AWS SDK for Rust: New test, still soaking Python, Go, CLI, Java, .NET, Rust
Report this
A test generated from the AWS model that has not yet run cleanly enough times to count.
Messages (6)AWS SDK for Python (boto3) eventually gave up after 6 attempt(s) 500ms apart; last failure: iam-gen-role/PutRolePermissionsBoundary: op=GetRole params={"RoleName": "oc-d1820877-py-iam-gen-role-r"} assertion=readback path=$.Role.PermissionsBoundary.PermissionsBoundaryType expected=equals "PermissionsBoundaryPolicy" actual="Policy" at compat/model/scenarios/iam.json assert[0].assert
AWS SDK for Go v2 eventually gave up after 6 attempt(s) 500ms apart; last failure: iam-gen-role/PutRolePermissionsBoundary: GetRole params {"RoleName":"oc-96df6583-go-iam-gen-role-r"}: readback equals at $.Role.PermissionsBoundary.PermissionsBoundaryType: expected "PermissionsBoundaryPolicy", actual "Policy" (compat/model/scenarios/iam.json assert[0].assert)
AWS CLI v2 eventually gave up after 6 attempt(s) 500ms apart; last failure: iam-gen-role/PutRolePermissionsBoundary: GetRole params {"RoleName":"oc-22ce13a6-cl-iam-gen-role-r"}: readback equals at $.Role.PermissionsBoundary.PermissionsBoundaryType: expected "PermissionsBoundaryPolicy", actual "Policy" (compat/model/scenarios/iam.json assert[0].assert)
AWS SDK for Java 2.x eventually gave up after 6 attempt(s) 500ms apart; last failure: iam-gen-role/PutRolePermissionsBoundary: GetRole params {"RoleName":"oc-cbe847d6-jv-iam-gen-role-r"}: readback equals at $.Role.PermissionsBoundary.PermissionsBoundaryType: expected "PermissionsBoundaryPolicy", actual "Policy" (compat/model/scenarios/iam.json assert[0].assert)
AWS SDK for .NET eventually gave up after 6 attempt(s) 500ms apart; last failure: iam-gen-role/PutRolePermissionsBoundary: GetRole params {"RoleName":"oc-45ab451a-dn-iam-gen-role-r"}: readback equals at $.Role.PermissionsBoundary.PermissionsBoundaryType: expected "PermissionsBoundaryPolicy", actual "Policy" (compat/model/scenarios/iam.json assert[0].assert)
AWS SDK for Rust eventually gave up after 6 attempt(s) 500ms apart; last failure: iam-gen-role/PutRolePermissionsBoundary: GetRole params {"RoleName":"oc-8f8b66e6-rs-iam-gen-role-r"}: readback equals at $.Role.PermissionsBoundary.PermissionsBoundaryType: expected "PermissionsBoundaryPolicy", actual "Policy" (compat/model/scenarios/iam.json assert[0].assert)
| |||||||
| DeleteRolePermissionsBoundary | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| GetAccountAuthorizationDetails | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| ListRoles | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| DeleteRole | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
iam-gen-user generated from the AWS model soaking
| Test | JS | Python | Go | CLI | Java | .NET | Rust |
|---|---|---|---|---|---|---|---|
| CreateUser | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| GetUser | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| UpdateUser | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| TagUser | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| ListUserTags | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| UntagUser | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| PutUserPolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| GetUserPolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| ListUserPolicies | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| DeleteUserPolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| AttachUserPolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| ListAttachedUserPolicies | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| DetachUserPolicy | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| CreateAccessKey | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| ListAccessKeys | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| DeleteAccessKey | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| PutUserPermissionsBoundary | AWS SDK for JavaScript v3: New test, still soaking | AWS SDK for Python (boto3): New test, still soaking | AWS SDK for Go v2: New test, still soaking | AWS CLI v2: New test, still soaking | AWS SDK for Java 2.x: New test, still soaking | AWS SDK for .NET: New test, still soaking | AWS SDK for Rust: New test, still soaking |
Why 7 results do not passA test generated from the AWS model that has not yet run cleanly enough times to count.
Message ScenarioFailure: eventually gave up after 6 attempt(s) 500ms apart; last failure: iam-gen-user/PutUserPermissionsBoundary: GetUser params={"UserName":"oc-207c52a7-nj-iam-gen-user-u"} — readback at $.User.PermissionsBoundary.PermissionsBoundaryType: expected "PermissionsBoundaryPolicy", actual "Policy" (compat/model/scenarios/iam.json assert[0].assert)
AWS SDK for Python (boto3), AWS SDK for Go v2, AWS CLI v2, AWS SDK for Java 2.x, AWS SDK for .NET, AWS SDK for Rust: New test, still soaking Python, Go, CLI, Java, .NET, Rust
Report this
A test generated from the AWS model that has not yet run cleanly enough times to count.
Messages (6)AWS SDK for Python (boto3) eventually gave up after 6 attempt(s) 500ms apart; last failure: iam-gen-user/PutUserPermissionsBoundary: op=GetUser params={"UserName": "oc-d1820877-py-iam-gen-user-u"} assertion=readback path=$.User.PermissionsBoundary.PermissionsBoundaryType expected=equals "PermissionsBoundaryPolicy" actual="Policy" at compat/model/scenarios/iam.json assert[0].assert
AWS SDK for Go v2 eventually gave up after 6 attempt(s) 500ms apart; last failure: iam-gen-user/PutUserPermissionsBoundary: GetUser params {"UserName":"oc-96df6583-go-iam-gen-user-u"}: readback equals at $.User.PermissionsBoundary.PermissionsBoundaryType: expected "PermissionsBoundaryPolicy", actual "Policy" (compat/model/scenarios/iam.json assert[0].assert)
AWS CLI v2 eventually gave up after 6 attempt(s) 500ms apart; last failure: iam-gen-user/PutUserPermissionsBoundary: GetUser params {"UserName":"oc-22ce13a6-cl-iam-gen-user-u"}: readback equals at $.User.PermissionsBoundary.PermissionsBoundaryType: expected "PermissionsBoundaryPolicy", actual "Policy" (compat/model/scenarios/iam.json assert[0].assert)
AWS SDK for Java 2.x eventually gave up after 6 attempt(s) 500ms apart; last failure: iam-gen-user/PutUserPermissionsBoundary: GetUser params {"UserName":"oc-cbe847d6-jv-iam-gen-user-u"}: readback equals at $.User.PermissionsBoundary.PermissionsBoundaryType: expected "PermissionsBoundaryPolicy", actual "Policy" (compat/model/scenarios/iam.json assert[0].assert)
AWS SDK for .NET eventually gave up after 6 attempt(s) 500ms apart; last failure: iam-gen-user/PutUserPermissionsBoundary: GetUser params {"UserName":"oc-45ab451a-dn-iam-gen-user-u"}: readback equals at $.User.PermissionsBoundary.PermissionsBoundaryType: expected "PermissionsBoundaryPolicy", actual "Policy" (compat/model/scenarios/iam.json assert[0].assert)
AWS SDK for Rust eventually gave up after 6 attempt(s) 500ms apart; last failure: iam-gen-user/PutUserPermissionsBoundary: GetUser params {"UserName":"oc-8f8b66e6-rs-iam-gen-user-u"}: readback equals at $.User.PermissionsBoundary.PermissionsBoundaryType: expected "PermissionsBoundaryPolicy", actual "Policy" (compat/model/scenarios/iam.json assert[0].assert)
| |||||||
| DeleteUserPermissionsBoundary | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| ListUsers | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
| DeleteUser | AWS SDK for JavaScript v3: passes | AWS SDK for Python (boto3): passes | AWS SDK for Go v2: passes | AWS CLI v2: passes | AWS SDK for Java 2.x: passes | AWS SDK for .NET: passes | AWS SDK for Rust: passes |
No test matches these filters.
Not tested (68)
Operations with no test at all. The test generator declined to write one, for the reason given.
| Operation | Reason | Detail |
|---|---|---|
| AcceptDelegationRequest | never-probe | AcceptDelegationRequest is not a read operation; probes call unimplemented operations against a live account and must be side-effect free |
| AcquireRole | never-probe | AcquireRole is not a read operation; probes call unimplemented operations against a live account and must be side-effect free |
| AddClientIDToOpenIDConnectProvider | never-probe | AddClientIDToOpenIDConnectProvider is not a read operation; probes call unimplemented operations against a live account and must be side-effect free |
| AssociateDelegationRequest | never-probe | AssociateDelegationRequest is not a read operation; probes call unimplemented operations against a live account and must be side-effect free |
| ChangePassword | never-probe | Changes the console password of the IAM user whose credentials signed the request, which locks that user out of the console until somebody with the new password says otherwise. |
| CreateAccountAlias | never-probe | Sets the account-wide sign-in alias. There is one per account, so the call silently replaces whatever the account already had, and every bookmarked sign-in URL for the old alias stops working. |
| CreateDelegationRequest | never-probe | CreateDelegationRequest is not a read operation; probes call unimplemented operations against a live account and must be side-effect free |
| CreateLoginProfile | never-probe | Gives an IAM user a console password. It turns a programmatic-only identity into one that can sign in to the console, which is a change to the account's attack surface rather than to a test fixture. |
| CreateOpenIDConnectProvider | never-probe | CreateOpenIDConnectProvider is not a read operation; probes call unimplemented operations against a live account and must be side-effect free |
| CreateSAMLProvider | never-probe | Registers a SAML identity provider for the account. Everything the provider's assertions are trusted for follows from it, and nothing in a probe group removes it. |
| CreateServiceLinkedRole | probe-of-implemented-op | CreateServiceLinkedRole is implemented (Supported), so it may not be probed, and no recipe resource gives it a role |
| CreateServiceSpecificCredential | never-probe | CreateServiceSpecificCredential is not a read operation; probes call unimplemented operations against a live account and must be side-effect free |
| CreateVirtualMFADevice | never-probe | Allocates a virtual MFA device with its own seed. AWS counts it against the account's device quota whether or not anybody ever enables it, and only DeleteVirtualMFADevice reclaims it. |
| DeactivateMFADevice | never-probe | Removes the MFA device from a user, so an identity that was protected by a second factor no longer is. |
| DeleteAccountAlias | never-probe | Removes the account's sign-in alias, breaking every sign-in URL built on it. |
| DeleteAccountPasswordPolicy | never-probe | Deletes the account-wide password policy, so every complexity, rotation and reuse rule the account relied on is gone at once and AWS keeps no copy to restore. |
| DeleteLoginProfile | never-probe | Removes an IAM user's console password, locking that user out of the console immediately. |
| DeleteOpenIDConnectProvider | never-probe | DeleteOpenIDConnectProvider is not a read operation; probes call unimplemented operations against a live account and must be side-effect free |
| DeleteSAMLProvider | never-probe | DeleteSAMLProvider is not a read operation; probes call unimplemented operations against a live account and must be side-effect free |
| DeleteSSHPublicKey | never-probe | DeleteSSHPublicKey is not a read operation; probes call unimplemented operations against a live account and must be side-effect free |
| DeleteServerCertificate | never-probe | DeleteServerCertificate is not a read operation; probes call unimplemented operations against a live account and must be side-effect free |
| DeleteServiceLinkedRole | never-probe | Starts the deletion of a service-linked role. The role is what an AWS service uses to act in the account, so deleting it stops that service working, and the deletion is asynchronous — the call returns a task id and cannot be taken back. |
| DeleteServiceSpecificCredential | never-probe | DeleteServiceSpecificCredential is not a read operation; probes call unimplemented operations against a live account and must be side-effect free |
| DeleteSigningCertificate | never-probe | Deletes an X.509 signing certificate from a user. Anything signing requests with that certificate stops being able to authenticate. |
| DeleteVirtualMFADevice | never-probe | Deletes a virtual MFA device. AWS keeps no copy of its seed, so the device cannot be recreated and whoever enrolled it has to enrol again. |
| DisableOrganizationsRootCredentialsManagement | never-probe | Turns off centralised root-credentials management for the organization, returning root credentials to each member account. It is an organization-wide security posture change made from one API call. |
| DisableOrganizationsRootSessions | never-probe | Turns off privileged root sessions for the organization's member accounts, changing what the management account can do in every one of them. |
| DisableOutboundWebIdentityFederation | never-probe | Turns off the account's outbound web identity federation, so every external workload that was exchanging this account's identity for a token stops being able to. |
| EnableMFADevice | never-probe | Associates an MFA device with a user and requires two consecutive authentication codes to do it. A probe would either enrol a device nobody asked to enrol or spend the user's authentication attempts guessing codes. |
| EnableOrganizationsRootCredentialsManagement | never-probe | Turns on centralised root-credentials management across the organization, which takes root credentials away from every member account. |
| EnableOrganizationsRootSessions | never-probe | Turns on privileged root sessions across the organization's member accounts. |
| EnableOutboundWebIdentityFederation | never-probe | Turns on outbound web identity federation for the account, which starts vending tokens that name this account to external workloads. |
| GenerateCredentialReport | never-probe | Starts the account-wide credential report job. It is billed, it is rate limited to one report every four hours, and it collects every credential's age and last-used data into a report a probe has no reason to want. |
| GenerateOrganizationsAccessReport | never-probe | GenerateOrganizationsAccessReport is not a read operation; probes call unimplemented operations against a live account and must be side-effect free |
| GenerateServiceLastAccessedDetails | never-probe | GenerateServiceLastAccessedDetails is not a read operation; probes call unimplemented operations against a live account and must be side-effect free |
| GetAccountProperties | never-probe | A read, and the one entry here that is not about danger. AWS added GetAccountProperties to the model after every SDK the typed suites pin: aws-sdk-go-v2/service/iam v1.53.7 declares no GetAccountPropertiesInput, so probing it scopes this whole probe group away from go-sdk with go-emit-unsupported, and the java, dotnet and rust emitters — which read the model rather than their SDK — would emit a call those builds cannot compile. It takes no required member, so withholding a curated literal, which is what leaves GetRoleTemplateVersion refused, cannot reach it and this map is the only lever. Delete the entry once the pins carry the operation. |
| GetRoleTemplateVersion | unbound-required-member | GetRoleTemplateVersion.TemplateArn (arnType, a string) has no bind, no matching export, no curated value and no derivable literal |
| PutAccountProperties | never-probe | Writes account-level IAM properties. There is one set per account, so a probe would overwrite the caller's own settings with no way to know what they were. |
| RejectDelegationRequest | never-probe | RejectDelegationRequest is not a read operation; probes call unimplemented operations against a live account and must be side-effect free |
| RemoveClientIDFromOpenIDConnectProvider | never-probe | RemoveClientIDFromOpenIDConnectProvider is not a read operation; probes call unimplemented operations against a live account and must be side-effect free |
| ResetServiceSpecificCredential | never-probe | ResetServiceSpecificCredential is not a read operation; probes call unimplemented operations against a live account and must be side-effect free |
| ResyncMFADevice | never-probe | Resynchronises a user's MFA device with two authentication codes, which consumes the user's codes and, on repeated failure, is what an attacker guessing them looks like. |
| SendDelegationToken | never-probe | SendDelegationToken is not a read operation; probes call unimplemented operations against a live account and must be side-effect free |
| SetDefaultPolicyVersion | never-probe | Changes which version of a managed policy is the operative one. Every principal the policy is attached to gets a different effective permission set the moment the call lands. |
| SetSecurityTokenServicePreferences | never-probe | Sets the account-wide STS global endpoint token version, which decides whether tokens the account mints are usable in Regions enabled after the call. |
| TagMFADevice | never-probe | TagMFADevice is not a read operation; probes call unimplemented operations against a live account and must be side-effect free |
| TagOpenIDConnectProvider | never-probe | TagOpenIDConnectProvider is not a read operation; probes call unimplemented operations against a live account and must be side-effect free |
| TagSAMLProvider | never-probe | TagSAMLProvider is not a read operation; probes call unimplemented operations against a live account and must be side-effect free |
| TagServerCertificate | never-probe | TagServerCertificate is not a read operation; probes call unimplemented operations against a live account and must be side-effect free |
| UntagMFADevice | never-probe | UntagMFADevice is not a read operation; probes call unimplemented operations against a live account and must be side-effect free |
| UntagOpenIDConnectProvider | never-probe | UntagOpenIDConnectProvider is not a read operation; probes call unimplemented operations against a live account and must be side-effect free |
| UntagSAMLProvider | never-probe | UntagSAMLProvider is not a read operation; probes call unimplemented operations against a live account and must be side-effect free |
| UntagServerCertificate | never-probe | UntagServerCertificate is not a read operation; probes call unimplemented operations against a live account and must be side-effect free |
| UpdateAccessKey | never-probe | Activates or deactivates an access key. Deactivating one an application is signing with breaks that application immediately, and a probe cannot know which keys are in use. |
| UpdateAccountPasswordPolicy | never-probe | Replaces the account-wide password policy wholesale. Unset members are reset to AWS's defaults rather than left alone, so a partial call silently relaxes rules the account depended on. |
| UpdateDelegationRequest | never-probe | UpdateDelegationRequest is not a read operation; probes call unimplemented operations against a live account and must be side-effect free |
| UpdateGroup | never-probe | UpdateGroup is not a read operation; probes call unimplemented operations against a live account and must be side-effect free |
| UpdateLoginProfile | never-probe | Sets a new console password for an IAM user, locking out whoever held the old one. |
| UpdateOpenIDConnectProviderThumbprint | never-probe | UpdateOpenIDConnectProviderThumbprint is not a read operation; probes call unimplemented operations against a live account and must be side-effect free |
| UpdateRoleDescription | never-probe | UpdateRoleDescription is not a read operation; probes call unimplemented operations against a live account and must be side-effect free |
| UpdateSAMLProvider | never-probe | Replaces the metadata document of a live SAML provider, which changes which assertions the account trusts. |
| UpdateSSHPublicKey | never-probe | UpdateSSHPublicKey is not a read operation; probes call unimplemented operations against a live account and must be side-effect free |
| UpdateServerCertificate | never-probe | UpdateServerCertificate is not a read operation; probes call unimplemented operations against a live account and must be side-effect free |
| UpdateServiceSpecificCredential | never-probe | UpdateServiceSpecificCredential is not a read operation; probes call unimplemented operations against a live account and must be side-effect free |
| UpdateSigningCertificate | never-probe | UpdateSigningCertificate is not a read operation; probes call unimplemented operations against a live account and must be side-effect free |
| UploadSSHPublicKey | never-probe | UploadSSHPublicKey is not a read operation; probes call unimplemented operations against a live account and must be side-effect free |
| UploadServerCertificate | never-probe | Uploads a server certificate and its private key into the account's IAM certificate store. A probe has no key to upload that is not either a real one or a fake the account then holds forever. |
| UploadSigningCertificate | never-probe | Uploads an X.509 signing certificate for a user, adding a new way to authenticate as that identity. |