Skip to content

AWS Service usage#16

Open
saurabh3460 wants to merge 56 commits intorunwhen-contrib:mainfrom
infracloudio:service-usage
Open

AWS Service usage#16
saurabh3460 wants to merge 56 commits intorunwhen-contrib:mainfrom
infracloudio:service-usage

Conversation

@saurabh3460
Copy link
Copy Markdown
Contributor

@saurabh3460 saurabh3460 commented Feb 7, 2025 •
edited
Loading

The SLI metrics are generated by executing the following task:

  • List AWS Service Usage Exceeding defined threshold

saurabh3460 and others added 30 commits November 20, 2024 17:14
@saurabh3460
add codebundles/aws-c7n-ebs-health/sli.robot
63adb4f
@saurabh3460
add c7n ebs policies
7a205bd
@saurabh3460
add script to create test infra
9ee4894
@saurabh3460
added runbook.robot with List Unattached EBS Volumes task
b86124b
@saurabh3460
Merge branch 'runwhen-contrib:main' into main
e1bd6e0
@saurabh3460
added parse_ebs_results func in Core.py
774460f
@saurabh3460
change name of unused-ebs-snapshots policy
9d5dd28
@saurabh3460
change secret__aws_account_id -> secret__aws_access_key_id
3dd7314
@saurabh3460
updated create/delete snapshot script in .test
b9505d0
@saurabh3460
added List Unused EBS Snapshots and List Unencrypted EBS Volumes task…
aa77f67 
…s in runbook
@saurabh3460
add runwhen generation rule and template yaml
780854e
@saurabh3460
clean cc lib
3455556
@saurabh3460
replace ebs test script with terraform
ecc92ff
@saurabh3460
remove volume check and add encrypted false in ebs.tf
cfb684b
@saurabh3460
added taskfile in ebs health codebundle
e9f4513
@saurabh3460
add account_id in ebs gen rule qualifiers
6102c59
@saurabh3460
add check-rwp-config task in ebs cb test's taskfile
4c59821
@saurabh3460
update ebs cb test README
90b306b
@saurabh3460
add encrypted filed in ebs tf file
7f81bd3
@saurabh3460
add suite variables AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY in eb…
9602af8 
…s health cb
@saurabh3460
add rw-cli-keywords dependency in requirements.txt
becadf9
@saurabh3460
fix sli locations filed in both ebs and s3 cb
37fd8b7
@saurabh3460
update Author in sli
5672dc9
@saurabh3460
fix Add Issue and change AWS_ACCOUNT_NAME -> AWS_ACCOUNT_ID
53c55bc
@saurabh3460
ebs Taskfile: add custom field and terraform/cb.secret
406e2fd
@saurabh3460
ebs sli: fix score logic
b0d6153
@saurabh3460
ebs runbook: update next steps string and task title
4580a3b
@saurabh3460
EBS CB: fix typo and update image url in templates
d7fce89
@saurabh3460
update intervalSeconds 300 -> 600
59c5463
@saurabh3460
EBS CB: update Metadata and thresholds defaults 1->0
d1caa2e
@saurabh3460
ebs cb: fix score logic
5d5f2c8
@saurabh3460
ebs cb: update REDME.md with how to test steps
7f557d0
@saurabh3460
ebs cb: update REDME.md with how to test steps
1b2699e
@saurabh3460
Merge remote-tracking branch 'upstream/main'
c78fbe9
@saurabh3460
Merge remote-tracking branch 'upstream/main'
4c9681b
@saurabh3460
Merge remote-tracking branch 'upstream/main'
638f32b
@saurabh3460
Merge remote-tracking branch 'upstream/main'
191873c
@saurabh3460
Merge remote-tracking branch 'upstream/main'
0548d37
@saurabh3460
Update c7n version to 0.9.43 in requirements.txt
5e63e7c
@saurabh3460
Add README for AWS Cloud Custodian Service Usage CodeBundle
9658c05
@saurabh3460
Add service usage policy template for AWS service quotas
718a5f3
@saurabh3460
Add utility function to generate usage tables from AWS resource logs
20ee761
@saurabh3460
Add generation rules and templates for AWS service usage monitoring
1c689f3
@saurabh3460
Add AWS Service Usage monitoring suite with threshold checks
57c73ba
@saurabh3460
Add runbook for listing AWS service usage exceeding defined thresholds
cf9c6cb
@saurabh3460
add placeholder for test infra
318c9b7
@saurabh3460
Add Util.py library to SLI robot suite
0b2b15f
@saurabh3460
Fix metric value conversion in AWS service usage check
50c39e9
@saurabh3460
Update usage percentage pattern to enforce positive integer values
a943aac
@saurabh3460
Update default AWS resource providers and set suite variables in runb…
ca9be89 
…ook and SLI files
@saurabh3460 saurabh3460 changed the title Service usage AWS Service usage Feb 11, 2025
@saurabh3460 saurabh3460 marked this pull request as ready for review February 11, 2025 09:54
@saurabh3460
Copy link
Copy Markdown
Contributor Author

saurabh3460 commented Feb 11, 2025

Note: No dedicated test infrastructure is provided for exceeding AWS service quotas. While it's possible to artificially increase service usage to 2% or 5% for testing, it's more easy to set the ${USAGE_PERCENTAGE} variable to 0. This allows to evaluate services with minimal or zero usage.

@stewartshea please let me know what do you think

@stewartshea
Copy link
Copy Markdown
Contributor

stewartshea commented May 15, 2025

@stewartshea to review

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@saurabh3460 @stewartshea