Job summary
Job post source
This job is directly from Anblicks
Job overview
The Lead DataBricks Engineer at Anblicks leads the design and optimization of data pipelines on Databricks, playing a key role in data governance, cost optimization, and technical leadership within the data engineering team.
Responsibilities and impact
The role involves leading Databricks platform development, architecting real-time and batch data ingestion with Kafka, managing data governance with Unity Catalog, integrating AWS services, optimizing costs, mentoring engineers, developing ETL/ELT pipelines, and collaborating with cross-functional teams.
Experience and skills
Candidates need 7+ years in data engineering with 3+ years in leadership, expertise in Databricks, Kafka, Unity Catalog, AWS cloud services, Python, Spark, and Delta Lake; Databricks certifications and experience with Apache Flink or CI/CD pipelines are bonuses.
Unique job features
This role uniquely combines leadership in Databricks platform management with hands-on development, advanced data governance using Unity Catalog, and cost optimization strategies on AWS.
Company overview
Anblicks is a data and analytics company specializing in providing cloud data engineering, data analytics, and AI solutions to help businesses make data-driven decisions. They generate revenue through consulting services, implementation of data solutions, and ongoing support and maintenance. Founded in 2004, Anblicks has grown to serve a global clientele, leveraging partnerships with major cloud providers like AWS, Microsoft Azure, and Google Cloud. Their expertise lies in transforming raw data into actionable insights, enabling companies to optimize operations and drive growth.
How to land this job
Position your resume to highlight leadership in Databricks platform design, development, and deployment, emphasizing your ability to establish best practices and mentor junior engineers.
Focus on showcasing your expertise in Apache Kafka for real-time and batch data ingestion, integration with Databricks, and optimization of Kafka consumers and producers.
Emphasize your experience with Databricks Unity Catalog for data governance, policy implementation, and collaboration with data governance teams to ensure compliance and data quality.
Highlight your proficiency with AWS services like S3, EC2, Lambda, and Glue, particularly in building scalable data infrastructures and optimizing cloud resource usage for cost efficiency.
Apply through multiple channels including Anblicks' corporate careers page and LinkedIn to maximize your chances of being noticed for the Lead Databricks Engineer role.
Connect with current data engineering or cloud infrastructure professionals at Anblicks on LinkedIn, using ice breakers such as commenting on recent Databricks innovations, asking about team culture, or inquiring about challenges in managing Databricks and AWS integrations.
Optimize your resume for ATS by including key terms from the job description such as 'Databricks platform leadership,' 'Apache Kafka,' 'Unity Catalog,' 'AWS cloud integration,' 'cost optimization,' and 'PySpark.'
Jennie Johnson's Power Apply feature can automate tailoring your resume, finding multiple application portals, and identifying relevant LinkedIn contacts, allowing you to focus your time on preparing for interviews and networking.
Jennie Johnson works for you!
Here’s what we do to make sure you’re successful:
Targeted Resume Revamp:
We expertly craft your resume to navigate Applicant Tracking Systems (ATS) and showcase your qualifications, making you stand out as a top-tier candidate.
Job Description Dissection:
Unpack the job posting with expert analysis, ensuring your application hits every key requirement.
Bespoke Cover Letter:
Capture the attention of hiring managers with a personalized cover letter that highlights how your skills align perfectly with the job's needs.
Interview Mastery:
Prepare for interviews like a pro with likely questions, strategic answers, and insightful questions for you to ask, setting you apart as an informed candidate.
Direct Application Insights:
Receive tailored advice on the best places to apply, ensuring your applications are seen by the right employers.
Skills and Gaps Assessment:
Identify and close critical skills gaps to position yourself as the best-fit candidate for your ideal job.
Personalized Email Pitch:
Make a memorable first impression with an email template crafted to engage potential employers and initiate meaningful conversations.
In-depth Research Guide:
Leverage comprehensive research tools to gather effective insights on companies, industry trends, and role-specific challenges.
Detailed Company Analysis:
Gain in-depth understanding of your prospective employer, giving you the edge in applications and interviews.
Strategic Candidate Overview:
Understand your unique value and why companies would want to interview you, highlighting your background and positioning.