[TASK] Deprecation of NGINX Ingress and bringing in Traefik Ingress

[khatrivarun]

Objectives:

• NGINX Ingress supported by the Kubernetes team has been deprecated and will not receive any updates after March 2026
• Replace the Ingress Helm Chart in the helm module with the Traefik Ingress
• Update all the annotations to handle things the Traefik way

[khatrivarun]

Ran the migration tool to check compatibility
Traefik 3.7 is currently EA and few annotations require 3.7, gonna check with the EA version if everything's hunk-dory