Databricks Practice Lead / Engineering Manager

Position Summary Scicom Infrastructure Services is seeking an experiencedDatabricks Practice Lead / Engineering Managerto provide hands-on technical leadership while managing a team of data engineers, architects, and consultants supporting complex enterprise and government programs. This role requires a senior Databricks expert who can design and oversee modern data platforms, establish technical standards, guide delivery teams, and remain actively involved in architecture, troubleshooting, code reviews, and client-facing solution development. The successful candidate will balance deep technical expertise with strong people leadership, delivery management, and stakeholder communication skills. Key Responsibilities Databricks Technical Leadership Serve as the organization’s subject-matter expert for the Databricks Lakehouse Platform. Design scalable, secure, and highly available data architectures using Databricks, Apache Spark, Delta Lake, and cloud-native technologies. Lead the implementation of batch, streaming, ETL, ELT, analytics, machine-learning, and AI-enabled data solutions. Define architectural standards for medallion architectures, data modeling, ingestion, transformation, orchestration, and data consumption. Establish governance frameworks using Unity Catalog, including data lineage, access controls, auditing, metadata management, and secure data sharing. Guide Databricks workspace design, cluster configuration, serverless computing, workload isolation, performance tuning, and cost optimization. Oversee integration between Databricks and cloud platforms such as Microsoft Azure, AWS, or Google Cloud. Develop or review solutions involving PySpark, Spark SQL, Python, Delta Live Tables, Structured Streaming, Auto Loader, MLflow, and Databricks Workflows. Lead platform migrations and modernization efforts from legacy databases, data warehouses, Hadoop environments, and traditional ETL platforms. Establish development standards for source control, automated tes