HRTMS Job Description Management
| Commercial Data Sr Engineer J o b D e s c r i p t i o n | | |
Job Profile Title: | Commercial Data Sr Engineer | Job Code: | 12779 | Business_Title | Commercial Data Sr Engineer | Profile Title: | 12779 Commercial Data Sr Engineer | Grade / Band: | IC3 | FLSA Status: | Exempt | The Senior Commercial Data Engineer is a technical leader responsible for designing, building, and maintaining high-quality, scalable, and reliable data products that power analytics, reporting, and advanced decision-making across the enterprise. This role owns curated data enablement, data observability, metric governance, and performance optimization within Databricks, ensuring the business has consistent, trusted, and high-performing datasets. | | | | | |
Principal Duties & Responsibilities | Lead cross-functional efforts to define and maintain certified business definitions, KPIs, and metric logic for assigned domains. | Design, document, and maintain enterprise-ready curated tables within Databricks following best practices. | Architect high-performance data models tailored to business needs and analytical patterns. | Optimize pipelines through partitioning, file compaction, and compute utilization tuning. | Enforce Unity Catalog standards for ownership, permissions, governance, and certification workflows. | Define and enforce data freshness SLAs, completeness thresholds, and schema drift detection. | Implement automated monitoring and anomaly detection for pipelines and metrics. | Own incident response, triage, and root-cause analysis for pipeline failures and metric discrepancies. | Drive query cost optimization and workload isolation for production stability. | Act as the primary data reliability owner for the business and train teams on certified datasets. |
Required for All Jobs | Performs other job-related duties as requested | Proof of eligibility to work in the United States |
Education | Education Level | Education Details | Required/ Preferred | Bachelor's Degree | Computer Science, Information Technology, or related field | Required | Master's Degree | Computer Science, Information Technology, or related field | Preferred | | | | | |
Work Experience | Experience | Experience Details | Required/ Preferred | 3+ Years of Prior Relevant Experience | Building production workloads in Databricks or similar Spark environment | Required | 5+ Years of Prior Relevant Experience | Data engineering, analytics engineering, or data platform roles | Required | | | | | |
Additional Requirements | Details | Required/ Preferred | Expertise in Databricks & Lakehouse platform. | Required | Strong coding skills in Python, PySpark, and SQL. | Required | Familiarity with Unity Catalog governance & permissions. | Required | Experience implementing data quality frameworks and observability. | Required | Domain Experience (at least one of the following): Gaming & Hospitality Operations, Loyalty & Customer Engagement, Marketing & Commercial Analytics. | Preferred | | | |
Knowledge, Skills and Abilities | KSAs | Ability to design curated tables and maintain certified business definitions. | Deep knowledge of Databricks, Delta Lake, and Unity Catalog standards. | Skills in partitioning, compaction, and compute tuning for large-scale workloads. | Experience defining SLAs, anomaly detection, and automated monitoring frameworks. | Ability to implement self-healing pipelines and manage incident response. | Expertise in analytical SQL, performance tuning, and distributed data processing. | Ability to write production-grade pipelines and automation scripts for validation and lineage. | Preferred experience with Terraform and orchestration tools like Airflow or Databricks Workflows. | Strong understanding of modeling patterns for analytics and operational systems. | Ability to translate technical requirements into business-aligned solutions. | Skills in query tuning and workload isolation for production stability. | Capacity to standardize best practices and mentor peers on platform enablement. |
Physical Requirements | A thorough completion of this section is needed for compliance with legal standards such as the Americans with Disabilities Act. The physical requirements described here are representative of those that must be met by an employee to successfully perform the essential functions of this job. | Physical Requirement | N/A | Rarely | Occasionally | Frequently | Constantly | Weight/ w.p.m. | Balancing | | | X | | | | Bending | | | X | | | | Carrying 10 pounds | | | X | | | | Clear speech - simple | | | | X | | | Clear speech - complex | | | | X | | | Climbing | X | | | | | | Distant vision | | | | X | | | Driving | X | | | | | | Flexibility - upper body | | | X | | | | Flexibility - lower body | | | X | | | | Hearing/Listening | | | | X | | | Kneeling | | | X | | | | Lifting 10 pounds | | | X | | | | Near vision | | | | X | | | Normal vision | | | | X | | | Pushing/Pulling | | | X | | | | Reaching | | | X | | | | Sitting | | | | X | | | Standing | | | X | | | | Typing | | | | X | | | Walking | | | | X | | | | | | | | | | | | | | | |
Work Environment | While performing the duties of this job, the associate is required to work within the selected work environments. | Work Environment | N/A | Rarely | Occasionally | Frequently | Constantly | Communication - verbal | | | | X | | Communication - written | | | | X | | Confined area | | | | X | | Contacts - works alone | | | | X | | Contacts - works around others | | | | X | | Contacts - works with others | | | | X | | Exposure to dust / dirt | | | X | | | Exposure to fumes / odors | | | X | | | Extreme cold | | X | | | | Extreme heat | | X | | | | Fast pace | | | | X | | Hazardous conditions - chemicals | X | | | | | Hazardous conditions - high structures | X | | | | | Hazardous conditions - high voltage | X | | | | | Indoors | | | | X | | Noise levels - low to moderate | | | | X | | Noise levels - high | | | X | | | Office conditions | | | | X | | Outdoors | | | X | | | Restricted area | | X | | | | Shifts | X | | | | | Smoke | | | X | | | Travel | | X | | | | Wet/Humid | | X | | | | | | | | | | | | | | |
Mental Requirements | While performing the duties of this job, the associate is required to work within the selected mental requirements. | Mental Requirement | N/A | Rarely | Occasionally | Frequently | Constantly | Analytical | | | | X | | Clerical | | | | X | | Comprehension | | | | X | | Crisis incidents | | X | | | | Customer service | | X | | | | Decision making | | | | X | | High pressure | | | | X | | Judgment | | | | X | | Long hours | | | X | | | Math skills - advance | | | X | | | Math skills - basic | | | | X | | Organization | | | | X | | Reading - simple | | | | X | | Reading - complex | | | | X | | Repetition | | | | X | | Tight deadlines | | | | X | | Writing - simple | | | | X | | Writing - complex | | | | X | | | | | | | | | | | | |
|