{"site":"airbnb.com","overall_health":"blocked","tasks":[{"site":"airbnb.com","task":"travel.cancel_hotel","health":"constrained","aes":48,"outcome_rate":0.48,"known_blockers":["login_required","human_handoff_required"],"recipe_uri":"recipe://travel.cancel_hotel/airbnb-cancel-reservation/v1","policy_notes":{"observation_method":"public_official_help_or_docs_page","observation_date":"2026-06-17","cancellation_path":"trips_reservation_details_cancel_reservation","refund_branching":"host_policy_listing_time_and_disruption_dependent","post_check_in":"may_require_host_or_support_interaction","source_urls":"https://www.airbnb.com/help/article/169 | https://www.airbnb.com/help/article/149 | https://www.airbnb.com/help/article/4052"},"confidence":{"score":0.3,"level":"low","sample_size":3,"rationale":"Confidence reflects 1.05 effective weight, Wilson bounds 0.052684-0.93873, and Beta posterior mean 0.493115."},"freshness":{"updated_at":"2026-06-17T05:35:02.532Z","age_days":0,"status":"fresh","rationale":"Latest evidence is 0 days old."},"evidence":{"sample_size":3,"source_tiers":["public_web_observation"],"evidence_ids":["public-airbnb-cancel-reservation","public-airbnb-cancellation-policies","public-airbnb-major-disruptive-events"],"latest_evidence_id":"public-airbnb-major-disruptive-events","notes":["Airbnb cancellation is account-gated through Trips and refundability depends on host policy, local listing time, and issue or disruption policies.","Source: https://www.airbnb.com/help/article/169","Source: https://www.airbnb.com/help/article/149","Source: https://www.airbnb.com/help/article/4052"]},"trust":{"score":0.32,"level":"low","reporter_count":0,"deduplicated_evidence_count":0,"quarantined_count":0,"rationale":"Low-trust public web observation from official or public task documentation; treat as directional until measured agent runs arrive."},"dimensions":[{"key":"reachability","score":36,"sample_size":3,"rationale":"Derived from AES 48 and observed friction for reachability."},{"key":"navigability","score":48,"sample_size":3,"rationale":"Derived from AES 48 and observed friction for navigability."},{"key":"task_completability","score":36,"sample_size":3,"rationale":"Derived from AES 48 and observed friction for task_completability."},{"key":"transactability","score":48,"sample_size":3,"rationale":"Derived from AES 48 and observed friction for transactability."},{"key":"recoverability","score":36,"sample_size":3,"rationale":"Derived from AES 48 and observed friction for recoverability."},{"key":"policy_parseability","score":48,"sample_size":3,"rationale":"Derived from AES 48 and observed friction for policy_parseability."},{"key":"trust_safety","score":48,"sample_size":3,"rationale":"Derived from AES 48 and observed friction for trust_safety."},{"key":"efficiency","score":36,"sample_size":3,"rationale":"Derived from AES 48 and observed friction for efficiency."}],"segments":[],"recommended_actions":[{"priority":"high","actor":"agent","action":"Treat Airbnb cancellation as policy-specific until the reservation refund screen is visible.","expected_impact":"Prevents overclaiming refunds from generic cancellation-policy text."},{"priority":"medium","actor":"agent","action":"Capture handoff evidence and pause before accepting retention offers.","expected_impact":"Keeps user intent explicit during adversarial cancellation flows."}]},{"site":"airbnb.com","task":"travel.cancel_third_party_booking","health":"blocked","aes":79,"outcome_rate":0.791,"known_blockers":["login_required","price_mismatch"],"recipe_uri":"recipe://airbnb.com/travel.cancel_third_party_booking/public-preflight-v1","policy_notes":{"public_path":"Official help or terms surface documents manage-booking, cancellation, refund, or provider-rule handling for third-party travel reservations.","task_family":"cancel","seo_angle":"Airbnb: Can AI Agents Safely Change or Cancel a Travel Booking?","confidence_note":"Official public help or legal pages expose the high-level path, but booking-specific refund amounts require an authenticated itinerary.","launch_set":"first_300_public_preflight"},"confidence":{"score":0.31,"level":"low","sample_size":4,"rationale":"Confidence reflects 1.16 effective weight, Wilson bounds 0.146956-0.98811, and Beta posterior mean 0.606875."},"freshness":{"updated_at":"2026-06-17T05:35:02.532Z","age_days":0,"status":"fresh","rationale":"Latest evidence is 0 days old."},"evidence":{"sample_size":4,"source_tiers":["public_web_observation"],"evidence_ids":["top100-travel-1-airbnbcom-travelcancel-third-party-booking","loop-1781004090881-airbnb-com-travel-cancel-third-party-booking"],"latest_evidence_id":"top100-travel-1-airbnbcom-travelcancel-third-party-booking","notes":["Official public help or legal pages expose the high-level path, but booking-specific refund amounts require an authenticated itinerary.","Source: https://www.airbnb.com/help/article/169","Source: https://www.airbnb.com/help/article/2972"]},"trust":{"score":0.38,"level":"low","reporter_count":1,"deduplicated_evidence_count":1,"quarantined_count":0,"rationale":"Trust is based on 1 deduplicated trusted run from 1 reporter."},"dimensions":[{"key":"reachability","score":67,"sample_size":4,"rationale":"Derived from AES 79 and observed friction for reachability."},{"key":"navigability","score":79,"sample_size":4,"rationale":"Derived from AES 79 and observed friction for navigability."},{"key":"task_completability","score":79,"sample_size":4,"rationale":"Derived from AES 79 and observed friction for task_completability."},{"key":"transactability","score":67,"sample_size":4,"rationale":"Derived from AES 79 and observed friction for transactability."},{"key":"recoverability","score":79,"sample_size":4,"rationale":"Derived from AES 79 and observed friction for recoverability."},{"key":"policy_parseability","score":79,"sample_size":4,"rationale":"Derived from AES 79 and observed friction for policy_parseability."},{"key":"trust_safety","score":67,"sample_size":4,"rationale":"Derived from AES 79 and observed friction for trust_safety."},{"key":"efficiency","score":79,"sample_size":4,"rationale":"Derived from AES 79 and observed friction for efficiency."}],"segments":[{"segment":{"stack":"codex-browser-loop","model":"gpt-5","browser_runtime":"codex-in-app-browser","identity_class":"agent_user"},"aes":80,"outcome_rate":0.8,"sample_size":1,"confidence":{"score":0.23,"level":"low","sample_size":1,"rationale":"Confidence reflects 0.11 effective weight, Wilson bounds 0.01802-0.998854, and Beta posterior mean 0.515797."},"freshness":{"updated_at":"2026-06-09T11:21:30.975Z","age_days":7.8,"status":"aging","rationale":"Latest evidence is 7.8 days old."},"known_blockers":["login_required"]}],"recommended_actions":[{"priority":"high","actor":"agent","action":"Do not book, cancel, change, or pay without explicit user approval.","expected_impact":"Keeps the agent inside documented, reversible, user-approved boundaries."},{"priority":"high","actor":"agent","action":"Require total-price verification immediately before final submission.","expected_impact":"Reduces high-regret transaction errors."}]},{"site":"airbnb.com","task":"customer_support.resolution_center","health":"degraded","aes":78,"outcome_rate":0.783,"known_blockers":["login_required","human_handoff_required","hidden_modal"],"recipe_uri":"recipe://airbnb.com/customer_support.resolution_center/public-preflight-v1","policy_notes":{"public_path":"Airbnb official public help/contact source -> select account, order, billing, refund, warranty, complaint, or service issue -> collect required identifiers and stop before submitting any support request, chat, claim, appeal, or account-recovery action.","task_family":"support","seo_angle":"Airbnb customer support preflight for AI agents: account gates, handoffs, and case signals","confidence_note":"Official public support/help source was used for a read-only preflight. Account-specific support, refunds, disputes, recovery, claims, and final submissions require user-present authorization.","launch_set":"first_300_public_preflight"},"confidence":{"score":0.29,"level":"low","sample_size":3,"rationale":"Confidence reflects 0.81 effective weight, Wilson bounds 0.107816-0.990776, and Beta posterior mean 0.581589."},"freshness":{"updated_at":"2026-06-17T05:35:02.532Z","age_days":0,"status":"fresh","rationale":"Latest evidence is 0 days old."},"evidence":{"sample_size":3,"source_tiers":["public_web_observation"],"evidence_ids":["top100-customer_support-17-airbnbcom-customer-supportresolution-center","loop-1781005574714-airbnb-com-customer-support-resolution-center"],"latest_evidence_id":"top100-customer_support-17-airbnbcom-customer-supportresolution-center","notes":["Official public support/help source was used for a read-only preflight. Account-specific support, refunds, disputes, recovery, claims, and final submissions require user-present authorization.","Source: https://www.airbnb.com/help"]},"trust":{"score":0.38,"level":"low","reporter_count":1,"deduplicated_evidence_count":1,"quarantined_count":0,"rationale":"Trust is based on 1 deduplicated trusted run from 1 reporter."},"dimensions":[{"key":"reachability","score":66,"sample_size":3,"rationale":"Derived from AES 78 and observed friction for reachability."},{"key":"navigability","score":78,"sample_size":3,"rationale":"Derived from AES 78 and observed friction for navigability."},{"key":"task_completability","score":66,"sample_size":3,"rationale":"Derived from AES 78 and observed friction for task_completability."},{"key":"transactability","score":78,"sample_size":3,"rationale":"Derived from AES 78 and observed friction for transactability."},{"key":"recoverability","score":66,"sample_size":3,"rationale":"Derived from AES 78 and observed friction for recoverability."},{"key":"policy_parseability","score":78,"sample_size":3,"rationale":"Derived from AES 78 and observed friction for policy_parseability."},{"key":"trust_safety","score":78,"sample_size":3,"rationale":"Derived from AES 78 and observed friction for trust_safety."},{"key":"efficiency","score":66,"sample_size":3,"rationale":"Derived from AES 78 and observed friction for efficiency."}],"segments":[{"segment":{"stack":"codex-browser-loop","model":"gpt-5","browser_runtime":"codex-in-app-browser","identity_class":"agent_user"},"aes":80,"outcome_rate":0.8,"sample_size":1,"confidence":{"score":0.23,"level":"low","sample_size":1,"rationale":"Confidence reflects 0.11 effective weight, Wilson bounds 0.018027-0.998854, and Beta posterior mean 0.515803."},"freshness":{"updated_at":"2026-06-09T11:46:14.806Z","age_days":7.7,"status":"aging","rationale":"Latest evidence is 7.7 days old."},"known_blockers":["login_required","hidden_modal"]}],"recommended_actions":[{"priority":"medium","actor":"agent","action":"Use public help/contact pages only until the user is present and has authorized account-specific support.","expected_impact":"Keeps the agent inside documented, reversible, user-approved boundaries."},{"priority":"medium","actor":"agent","action":"Capture handoff evidence and pause before accepting retention offers.","expected_impact":"Keeps user intent explicit during adversarial cancellation flows."}]},{"site":"airbnb.com","task":"travel.find_reservation_cancellation_policy","health":"degraded","aes":80,"outcome_rate":0.8,"known_blockers":["login_required"],"recipe_uri":null,"policy_notes":{},"confidence":{"score":0.23,"level":"low","sample_size":1,"rationale":"Confidence reflects 0.11 effective weight, Wilson bounds 0.018134-0.998847, and Beta posterior mean 0.515894."},"freshness":{"updated_at":"2026-06-09T18:04:11.898Z","age_days":7.5,"status":"aging","rationale":"Latest evidence is 7.5 days old."},"evidence":{"sample_size":1,"source_tiers":["public_web_observation"],"evidence_ids":["loop-1781028251626-airbnb-com-travel-find-reservation-cancellation-policy"],"latest_evidence_id":"loop-1781028251626-airbnb-com-travel-find-reservation-cancellation-policy","notes":["Status is derived from reported runs stored in this server process."]},"trust":{"score":0.38,"level":"low","reporter_count":1,"deduplicated_evidence_count":1,"quarantined_count":0,"rationale":"Trust is based on 1 deduplicated trusted run from 1 reporter."},"dimensions":[{"key":"reachability","score":68,"sample_size":1,"rationale":"Derived from AES 80 and observed friction for reachability."},{"key":"navigability","score":80,"sample_size":1,"rationale":"Derived from AES 80 and observed friction for navigability."},{"key":"task_completability","score":80,"sample_size":1,"rationale":"Derived from AES 80 and observed friction for task_completability."},{"key":"transactability","score":80,"sample_size":1,"rationale":"Derived from AES 80 and observed friction for transactability."},{"key":"recoverability","score":80,"sample_size":1,"rationale":"Derived from AES 80 and observed friction for recoverability."},{"key":"policy_parseability","score":80,"sample_size":1,"rationale":"Derived from AES 80 and observed friction for policy_parseability."},{"key":"trust_safety","score":80,"sample_size":1,"rationale":"Derived from AES 80 and observed friction for trust_safety."},{"key":"efficiency","score":80,"sample_size":1,"rationale":"Derived from AES 80 and observed friction for efficiency."}],"segments":[{"segment":{"stack":"codex-browser-loop","model":"gpt-5","browser_runtime":"codex-in-app-browser","identity_class":"agent_user"},"aes":80,"outcome_rate":0.8,"sample_size":1,"confidence":{"score":0.23,"level":"low","sample_size":1,"rationale":"Confidence reflects 0.11 effective weight, Wilson bounds 0.018134-0.998847, and Beta posterior mean 0.515894."},"freshness":{"updated_at":"2026-06-09T18:04:11.898Z","age_days":7.5,"status":"aging","rationale":"Latest evidence is 7.5 days old."},"known_blockers":["login_required"]}],"recommended_actions":[{"priority":"medium","actor":"agent","action":"Use preflight output as the execution guardrail and report the final outcome.","expected_impact":"Improves future confidence and catches drift."}]},{"site":"airbnb.com","task":"travel.find_cancellation_policy_help","health":"degraded","aes":80,"outcome_rate":0.8,"known_blockers":["login_required","hidden_modal","forced_account_creation"],"recipe_uri":null,"policy_notes":{},"confidence":{"score":0.23,"level":"low","sample_size":1,"rationale":"Confidence reflects 0.11 effective weight, Wilson bounds 0.018117-0.998848, and Beta posterior mean 0.51588."},"freshness":{"updated_at":"2026-06-09T17:05:15.608Z","age_days":7.5,"status":"aging","rationale":"Latest evidence is 7.5 days old."},"evidence":{"sample_size":1,"source_tiers":["public_web_observation"],"evidence_ids":["loop-1781024715489-airbnb-com-travel-find-cancellation-policy-help"],"latest_evidence_id":"loop-1781024715489-airbnb-com-travel-find-cancellation-policy-help","notes":["Status is derived from reported runs stored in this server process."]},"trust":{"score":0.38,"level":"low","reporter_count":1,"deduplicated_evidence_count":1,"quarantined_count":0,"rationale":"Trust is based on 1 deduplicated trusted run from 1 reporter."},"dimensions":[{"key":"reachability","score":68,"sample_size":1,"rationale":"Derived from AES 80 and observed friction for reachability."},{"key":"navigability","score":68,"sample_size":1,"rationale":"Derived from AES 80 and observed friction for navigability."},{"key":"task_completability","score":80,"sample_size":1,"rationale":"Derived from AES 80 and observed friction for task_completability."},{"key":"transactability","score":80,"sample_size":1,"rationale":"Derived from AES 80 and observed friction for transactability."},{"key":"recoverability","score":80,"sample_size":1,"rationale":"Derived from AES 80 and observed friction for recoverability."},{"key":"policy_parseability","score":80,"sample_size":1,"rationale":"Derived from AES 80 and observed friction for policy_parseability."},{"key":"trust_safety","score":80,"sample_size":1,"rationale":"Derived from AES 80 and observed friction for trust_safety."},{"key":"efficiency","score":68,"sample_size":1,"rationale":"Derived from AES 80 and observed friction for efficiency."}],"segments":[{"segment":{"stack":"codex-browser-loop","model":"gpt-5","browser_runtime":"codex-in-app-browser","identity_class":"agent_user"},"aes":80,"outcome_rate":0.8,"sample_size":1,"confidence":{"score":0.23,"level":"low","sample_size":1,"rationale":"Confidence reflects 0.11 effective weight, Wilson bounds 0.018117-0.998848, and Beta posterior mean 0.51588."},"freshness":{"updated_at":"2026-06-09T17:05:15.608Z","age_days":7.5,"status":"aging","rationale":"Latest evidence is 7.5 days old."},"known_blockers":["login_required","hidden_modal","forced_account_creation"]}],"recommended_actions":[{"priority":"medium","actor":"agent","action":"Use preflight output as the execution guardrail and report the final outcome.","expected_impact":"Improves future confidence and catches drift."}]},{"site":"airbnb.com","task":"future_agent_tasks.monitor_prices","health":"healthy","aes":100,"outcome_rate":1,"known_blockers":[],"recipe_uri":null,"policy_notes":{},"confidence":{"score":0.23,"level":"low","sample_size":1,"rationale":"Confidence reflects 0.11 effective weight, Wilson bounds 0.02816-1, and Beta posterior mean 0.526361."},"freshness":{"updated_at":"2026-06-09T12:42:13.033Z","age_days":7.7,"status":"aging","rationale":"Latest evidence is 7.7 days old."},"evidence":{"sample_size":1,"source_tiers":["public_web_observation"],"evidence_ids":["loop-1781008932892-airbnb-com-future-agent-tasks-monitor-prices"],"latest_evidence_id":"loop-1781008932892-airbnb-com-future-agent-tasks-monitor-prices","notes":["Status is derived from reported runs stored in this server process."]},"trust":{"score":0.38,"level":"low","reporter_count":1,"deduplicated_evidence_count":1,"quarantined_count":0,"rationale":"Trust is based on 1 deduplicated trusted run from 1 reporter."},"dimensions":[{"key":"reachability","score":100,"sample_size":1,"rationale":"Derived from AES 100 and observed friction for reachability."},{"key":"navigability","score":100,"sample_size":1,"rationale":"Derived from AES 100 and observed friction for navigability."},{"key":"task_completability","score":100,"sample_size":1,"rationale":"Derived from AES 100 and observed friction for task_completability."},{"key":"transactability","score":100,"sample_size":1,"rationale":"Derived from AES 100 and observed friction for transactability."},{"key":"recoverability","score":100,"sample_size":1,"rationale":"Derived from AES 100 and observed friction for recoverability."},{"key":"policy_parseability","score":100,"sample_size":1,"rationale":"Derived from AES 100 and observed friction for policy_parseability."},{"key":"trust_safety","score":100,"sample_size":1,"rationale":"Derived from AES 100 and observed friction for trust_safety."},{"key":"efficiency","score":100,"sample_size":1,"rationale":"Derived from AES 100 and observed friction for efficiency."}],"segments":[{"segment":{"stack":"codex-browser-loop","model":"gpt-5","browser_runtime":"codex-in-app-browser","identity_class":"agent_user"},"aes":100,"outcome_rate":1,"sample_size":1,"confidence":{"score":0.23,"level":"low","sample_size":1,"rationale":"Confidence reflects 0.11 effective weight, Wilson bounds 0.02816-1, and Beta posterior mean 0.526361."},"freshness":{"updated_at":"2026-06-09T12:42:13.033Z","age_days":7.7,"status":"aging","rationale":"Latest evidence is 7.7 days old."},"known_blockers":[]}],"recommended_actions":[{"priority":"medium","actor":"agent","action":"Use preflight output as the execution guardrail and report the final outcome.","expected_impact":"Improves future confidence and catches drift."}]}],"incidents":[{"id":"incident_airbnb_com_travel_cancel_third_party_booking","task":"travel.cancel_third_party_booking","severity":"high","opened_at":"2026-06-17T05:35:02.532Z","status":"open","summary":"Blocking friction observed for travel.cancel_third_party_booking: login_required, price_mismatch"}],"confidence":{"score":0.26,"level":"low","sample_size":13,"rationale":"Aggregated across available task-level confidence summaries."},"freshness":{"updated_at":"2026-06-17T05:35:02.532Z","age_days":0,"status":"fresh","rationale":"Latest evidence is 0 days old."},"evidence":{"sample_size":13,"source_tiers":["public_web_observation"],"evidence_ids":["public-airbnb-cancel-reservation","public-airbnb-cancellation-policies","public-airbnb-major-disruptive-events","top100-travel-1-airbnbcom-travelcancel-third-party-booking","loop-1781004090881-airbnb-com-travel-cancel-third-party-booking","top100-customer_support-17-airbnbcom-customer-supportresolution-center","loop-1781005574714-airbnb-com-customer-support-resolution-center","loop-1781028251626-airbnb-com-travel-find-reservation-cancellation-policy","loop-1781024715489-airbnb-com-travel-find-cancellation-policy-help","loop-1781008932892-airbnb-com-future-agent-tasks-monitor-prices"],"latest_evidence_id":"loop-1781008932892-airbnb-com-future-agent-tasks-monitor-prices","notes":["Airbnb cancellation is account-gated through Trips and refundability depends on host policy, local listing time, and issue or disruption policies.","Source: https://www.airbnb.com/help/article/169","Source: https://www.airbnb.com/help/article/149","Source: https://www.airbnb.com/help/article/4052","Official public help or legal pages expose the high-level path, but booking-specific refund amounts require an authenticated itinerary.","Source: https://www.airbnb.com/help/article/2972","Official public support/help source was used for a read-only preflight. Account-specific support, refunds, disputes, recovery, claims, and final submissions require user-present authorization.","Source: https://www.airbnb.com/help","Status is derived from reported runs stored in this server process."]},"trust":{"score":0.37,"level":"low","reporter_count":5,"deduplicated_evidence_count":5,"quarantined_count":0,"rationale":"Aggregated across task or site trust summaries."},"recommended_actions":[{"priority":"high","actor":"agent","action":"Treat Airbnb cancellation as policy-specific until the reservation refund screen is visible.","expected_impact":"Prevents overclaiming refunds from generic cancellation-policy text."},{"priority":"medium","actor":"agent","action":"Capture handoff evidence and pause before accepting retention offers.","expected_impact":"Keeps user intent explicit during adversarial cancellation flows."},{"priority":"high","actor":"agent","action":"Do not book, cancel, change, or pay without explicit user approval.","expected_impact":"Keeps the agent inside documented, reversible, user-approved boundaries."},{"priority":"high","actor":"agent","action":"Require total-price verification immediately before final submission.","expected_impact":"Reduces high-regret transaction errors."},{"priority":"medium","actor":"agent","action":"Use public help/contact pages only until the user is present and has authorized account-specific support.","expected_impact":"Keeps the agent inside documented, reversible, user-approved boundaries."}]}