Dataface Tasks
    Heartbeat snapshot (JSON)

    Enable 5T Analytics connectivity for analyst pilot

    IDM1-INTPLAT-001
    Statusnot_started
    Priorityp0
    Milestonem1-ft-analytics-analyst-pilot
    Ownerhead-of-engineering

    Problem

    Dataface running on Fivetran infrastructure cannot currently connect to the FT Analytics data warehouse. The data path (BigQuery/Snowflake credentials), secrets management (how warehouse credentials are stored and rotated in GCP Secret Manager), and environment configuration (which project, dataset, and service account the Cloud Run instance uses) are not wired up. Until this connectivity is established, pilot analysts have no data to query and the entire M1 pilot is blocked.

    Context

    • This task is specifically about warehouse connectivity after the hosting path exists.
    • Hosting and Cloud Run deployment mechanics are tracked separately in task-m1-fivetran-gcp-deploy-path.md and host-dataface-on-fivetran-gcp.md.
    • The deliverable here is a working data connection from the pilot runtime to the 5T Analytics warehouse, not the entire deploy/runbook stack.

    Possible Solutions

    • A - Keep connectivity manual and environment-specific for each run: workable for emergencies, but too fragile for the analyst pilot.
    • B - Recommended: define and harden one FT Analytics connectivity path: make credentials, secrets, runtime config, and failure handling explicit so the hosted pilot can depend on it.
    • C - Build a broader generalized connectivity abstraction first: valuable later, but slower than the pilot needs.

    Plan

    1. Confirm the warehouse target, service account, and secret inventory required for the pilot runtime.
    2. Wire runtime secrets and environment variables so the deployed service can authenticate to the warehouse.
    3. Verify Dataface can execute the minimum required pilot queries against 5T Analytics from the hosted environment.
    4. Document the exact connectivity contract and remaining known limitations.

    Implementation Progress

    • Boundary clarified: this task owns warehouse access from the running pilot environment, not generic GCP deployment plumbing.
    • Acceptance should be demonstrated with a hosted end-to-end connectivity check, not just config docs.

    Review Feedback

    • [ ] Review cleared