IFO4
Loading...Side-by-side IFO4 MATRIX comparison graded against TGS:001:2026. 90 items, every row marked with a winner once both vendors have evidence on file.
Every row is a TGS test case. The Winner column resolves once both vendors have grades on file. Until then, both columns and the winner column show pending.
| Code | Item | Honeycomb | Datadog | Winner |
|---|---|---|---|---|
| TGS-FIN-V-01 | Multi-Cloud Cost Ingestion Ingest billing + usage data from AWS, Azure, GCP, OCI into a single normalized data model. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-V-02 | Usage Data Completeness All cost lines come paired with usage data sufficient to drive optimization recommendations. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-V-03 | SaaS Spend Ingestion Ingest SaaS subscription cost + usage from finance, SSO, and direct vendor integrations. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-V-04 | Kubernetes Cost Visibility Per-namespace, per-workload, per-pod cost attribution inside K8s clusters across cloud and on-prem. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-V-05 | On-Prem / DC Cost Modeling Datacenter, private cloud, and colo cost modeling unified with public cloud cost. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-V-06 | Real-Time Reporting Sub-day cost telemetry rather than batch refresh. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-V-07 | Data Freshness Transparency User can see exactly when each cost line was last refreshed. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-V-08 | Invoice Reconciliation Match ingested cost to actual cloud invoices and surface deltas. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-V-09 | Resource-Level Visibility Drill from invoice down to individual resource (instance, bucket, function, pod). | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-V-10 | Service-Level Breakdown Cost split by cloud service (EC2, S3, Lambda, BigQuery, etc.) with deep service taxonomy. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-V-11 | Region / Account Visibility Multi-region, multi-account, multi-subscription views with org-aware hierarchy. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-V-12 | Cross-Environment Aggregation Roll up dev / staging / prod or business-unit views with consistent allocation. | ⚫ pending | ⚫ pending | pending |
| Code | Item | Honeycomb | Datadog | Winner |
|---|---|---|---|---|
| TGS-FIN-A-01 | Tag-Based Allocation Group cost by cloud-resource tags / labels. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-A-02 | Label-Based Allocation (K8s) K8s / cluster label allocation distinct from cloud tags. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-A-03 | Account / Subscription Allocation Allocate by AWS account / Azure subscription / GCP project. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-A-04 | Shared Cost Allocation Distribute platform / network / shared cost across consumers using configurable rules. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-A-05 | Platform Allocation (K8s / Network) Per-consumer allocation of K8s control-plane and network costs. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-A-06 | Proportional Allocation Distribute costs by configurable ratios. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-A-07 | Fixed Allocation Static dollar amounts assigned to consumers. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-A-08 | Untagged Cost Handling Surface and route untagged / unallocated cost. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-A-09 | Chargeback Readiness Generate invoices to internal cost-centers in finance-grade format. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-A-10 | Allocation Audit Trail Log every change to allocation rules with attribution and effective dates. | ⚫ pending | ⚫ pending | pending |
| Code | Item | Honeycomb | Datadog | Winner |
|---|---|---|---|---|
| TGS-FIN-O-01 | Orphaned Resource Detection Detect unattached storage, unused IPs, orphaned snapshots. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-O-02 | Idle vs Underutilized Separation Distinguish "doing nothing" from "doing too little". | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-O-03 | Storage Waste Classification Tier storage by access pattern, identify cold-on-hot waste. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-O-04 | Compute Rightsizing CPU / memory / network analysis driving instance recommendations. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-O-05 | Storage Rightsizing Volume / tier recommendations. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-O-06 | Instance Family Upgrades Recommend newer-generation families for cost / perf gains. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-O-07 | Architecture-Level Inefficiency Detect inefficient design patterns, not just resource sizing. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-O-08 | RI / SP / CUD Recommendations Recommend reserved capacity / savings plans / committed use discounts. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-O-09 | Commitment Coverage Analysis Track how much of spend is covered by commitments. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-O-10 | Spot / Preemptible Viability Classify workloads as spot-suitable. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-O-11 | Auto-Remediation Programmatically apply fixes (terminate, resize, retire). | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-O-12 | Savings Validation Verify recommended savings actually realized. | ⚫ pending | ⚫ pending | pending |
| Code | Item | Honeycomb | Datadog | Winner |
|---|---|---|---|---|
| TGS-FIN-F-01 | Spend Forecasting Project future spend across horizons. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-F-02 | Usage Forecasting Project future consumption (vCPU-hours, GB-months, tokens). | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-F-03 | Forecast vs Actual Tracking Track and explain forecast accuracy over time. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-F-04 | Budget Integration Connect to FP&A budgets, enforce limits. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-F-05 | Scenario Modeling What-if cost simulations. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-F-06 | Business Driver Modeling Tie cost forecasts to business drivers (orders, users, transactions). | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-F-07 | ERP Alignment Sync to NetSuite / SAP / Workday / Oracle ERP. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-F-08 | Renewal Forecasting Project SaaS / commitment / license renewals. | ⚫ pending | ⚫ pending | pending |
| Code | Item | Honeycomb | Datadog | Winner |
|---|---|---|---|---|
| TGS-FIN-AU-01 | Event-Driven Automation Webhook / event-bus triggers for cost actions. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-AU-02 | Workflow / Ticketing Integration Jira / ServiceNow / Asana / Linear integrations. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-AU-03 | API Completeness Public REST / GraphQL covering all UI features. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-AU-04 | IaC Integration Terraform / Pulumi / CloudFormation integration for cost gating. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-AU-05 | Auto-Termination Programmatic shutdown of idle / orphaned resources. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-AU-06 | Auto-Resize w/ Guardrails Automatic resizing under safety policies. | ⚫ pending | ⚫ pending | pending |
| Code | Item | Honeycomb | Datadog | Winner |
|---|---|---|---|---|
| TGS-FIN-G-01 | Policy Enforcement Codified rules that block / quarantine non-compliant cost. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-G-02 | RBAC Role-based access control with org-hierarchy support. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-G-03 | Approval Workflows Multi-step approval flows for actions / budget overrides. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-G-04 | Audit Logs Immutable record of all user / system actions. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-G-05 | Anomaly Detection ML / heuristic detection of cost anomalies. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-G-06 | Compliance Alignment Mapping to SOC 2 / ISO 27001 / FedRAMP / HIPAA. | ⚫ pending | ⚫ pending | pending |
| Code | Item | Honeycomb | Datadog | Winner |
|---|---|---|---|---|
| TGS-FIN-AI-01 | Token Cost Tracking Per-call token-cost telemetry across LLM providers. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-AI-02 | Model-Level Attribution Cost attributed per model version / variant. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-AI-03 | GPU Utilization Tracking GPU memory / SM utilization with cost overlay. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-AI-04 | Training vs Inference Separation Split training cost from inference cost cleanly. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-AI-05 | Agent Cost Tracking Per-agent / per-task cost for autonomous AI workflows. | ⚫ pending | ⚫ pending | pending |
| TGS-FIN-AI-06 | AI ROI Measurement Tie model cost to business outcomes (deflection, retention, automation). | ⚫ pending | ⚫ pending | pending |
| Code | Item | Honeycomb | Datadog | Winner |
|---|---|---|---|---|
| TGS-SEC-T-01 | SIEM Ingestion Breadth Range of sources / formats the SIEM ingests cleanly. | ⚫ pending | ⚫ pending | pending |
| TGS-SEC-T-02 | Detection Rule Coverage Out-of-the-box and custom detection rule library. | ⚫ pending | ⚫ pending | pending |
| TGS-SEC-T-03 | MITRE ATT&CK Mapping Detections mapped to MITRE ATT&CK techniques. | ⚫ pending | ⚫ pending | pending |
| TGS-SEC-T-04 | Behavioral Analytics (UEBA) User / entity behavioral anomaly detection. | ⚫ pending | ⚫ pending | pending |
| TGS-SEC-T-05 | Cross-Source Correlation Correlate signals across multiple data sources. | ⚫ pending | ⚫ pending | pending |
| TGS-SEC-T-06 | MTTD / MTTR Tracking Mean time to detect / respond reporting. | ⚫ pending | ⚫ pending | pending |
| TGS-SEC-T-07 | Auto-Response Playbooks SOAR-style automated response playbooks. | ⚫ pending | ⚫ pending | pending |
| TGS-SEC-T-08 | Forensics Depth Deep historical telemetry and replayable timelines. | ⚫ pending | ⚫ pending | pending |
| Code | Item | Honeycomb | Datadog | Winner |
|---|---|---|---|---|
| TGS-SEC-C-01 | Misconfiguration Detection Detect cloud misconfigurations against benchmarks. | ⚫ pending | ⚫ pending | pending |
| TGS-SEC-C-02 | Configuration Drift Detection Detect drift from approved baselines. | ⚫ pending | ⚫ pending | pending |
| TGS-SEC-C-03 | Multi-Cloud Posture Coverage Single pane across AWS / Azure / GCP / OCI. | ⚫ pending | ⚫ pending | pending |
| TGS-SEC-C-04 | IaC Scanning Pre-deploy scanning of Terraform / CloudFormation / Helm. | ⚫ pending | ⚫ pending | pending |
| TGS-SEC-C-05 | Compliance Frameworks Pre-built mappings to common compliance frameworks (CIS / NIST / PCI / HIPAA / FedRAMP). | ⚫ pending | ⚫ pending | pending |
| TGS-SEC-C-06 | Risk-Based Prioritization Surface findings by exploitability + asset criticality. | ⚫ pending | ⚫ pending | pending |
| Code | Item | Honeycomb | Datadog | Winner |
|---|---|---|---|---|
| TGS-SEC-I-01 | SSO Breadth Number of integrated SaaS apps via SAML / OIDC / SCIM. | ⚫ pending | ⚫ pending | pending |
| TGS-SEC-I-02 | MFA Enforcement Policy-driven MFA enforcement at scale. | ⚫ pending | ⚫ pending | pending |
| TGS-SEC-I-03 | Privileged Access Management (PAM) Vaulting, session recording, just-in-time elevation. | ⚫ pending | ⚫ pending | pending |
| TGS-SEC-I-04 | Identity Threat Detection Detect identity-based attacks (token theft, OAuth abuse). | ⚫ pending | ⚫ pending | pending |
| TGS-SEC-I-05 | Session Monitoring Live session telemetry for high-risk users / actions. | ⚫ pending | ⚫ pending | pending |
| Code | Item | Honeycomb | Datadog | Winner |
|---|---|---|---|---|
| TGS-SEC-V-01 | Asset Coverage Breadth of asset types scanned (cloud, on-prem, OT, container). | ⚫ pending | ⚫ pending | pending |
| TGS-SEC-V-02 | Authenticated Scanning Authenticated / agent-based scanning depth. | ⚫ pending | ⚫ pending | pending |
| TGS-SEC-V-03 | Patch Tracking Track patch state and SLAs across the fleet. | ⚫ pending | ⚫ pending | pending |
| TGS-SEC-V-04 | Risk-Based Vuln Prioritization EPSS / CVSS / asset-criticality combined. | ⚫ pending | ⚫ pending | pending |
| Code | Item | Honeycomb | Datadog | Winner |
|---|---|---|---|---|
| TGS-SEC-SF-01 | Security Tool Cost Visibility Cost of each security tool surfaced to FinOps view. | ⚫ pending | ⚫ pending | pending |
| TGS-SEC-SF-02 | License Utilization (Security Tools) Track seat / capacity utilization for security platforms. | ⚫ pending | ⚫ pending | pending |
| TGS-SEC-SF-03 | Alert Volume vs Cost Cost-per-alert / cost-per-true-positive metrics. | ⚫ pending | ⚫ pending | pending |
| TGS-SEC-SF-04 | Coverage vs Risk-Spend Ratio Coverage outcome divided by tool spend. | ⚫ pending | ⚫ pending | pending |
| TGS-SEC-SF-05 | Tool Overlap Detection Detect overlapping capabilities across security tools. | ⚫ pending | ⚫ pending | pending |
| TGS-SEC-SF-06 | ROI Per Security Control Quantified return per security control / category. | ⚫ pending | ⚫ pending | pending |
| TGS-SEC-SF-07 | Insurance Premium Impact Tools that demonstrably affect cyber-insurance premiums. | ⚫ pending | ⚫ pending | pending |