Databricks Data Architect

Hello Applicant - I hope this message finds you in good health. We have a Fulltime/Perm role available with my direct client, where, in addition to a base salary, you will have access to health/medical/dental benefits, PTO, and much more.

Job Description:Job Title: Data Architect (Databricks)Location: Dublin, Ohio, United StatesFull Time.

Role & Responsibilities Overview:Lead and/or assist in designing and developing data systems, tailoring solutions to meet client specific requirementsDesign and implement databricks based solutions with a focus on distributed data processing , data partitioning and optimization for parallelismEngage with client to evaluate their current and future needs, crafting bespoke solution architectures and providing strategic recommendationsDevelop comprehensive architecture solution roadmaps integrating client business processes and technologiesDefine and enforce coding standards for ETL processes, ensuring maintainability, reusability, and adherence to best practicesArchitect and implement CI/CD pipelines for databricks notebooks and jobs, ensuring testing , versioning and deploymentDisaster recovery strategies for databricks environments, ensuring data resilience and minimal downtime in case of failureInnovate and expand solution offerings to address data challengesAdvise stakeholders on data cloud platform architecture optimization, focusing on performanceExperienced with Scrum and Agile Methodologies to coordinate global delivery teams, run scrum ceremonies, manage backlog items, and handle escalationsIntegrate data across different systems and platformsStrong verbal and written communication skills to manage client discussions Candidate Profile:5+ years experience in architecture, design and implementation using databricksExperience in designing and implementing scalable, fault tolerant systemsDeep understanding of one or more of the big data compute technologies such as databricks, snowflakeDemonstrated experience with the deployment of databricks on cloud platforms , including advanced configurationsIn depth knowledge of spark internals, catalyst optimization, and databricks runtime environmentMust have experience in implementing solution using DatabricksExperience in Insurance (P&C) is good to haveProgramming Languages – SQL, PythonTechnologies – Databricks, Delta Lake storage, Spark (PySpark, Spark SQL). Good to have - Airflow, Splunk, Kubernetes, Power BI, Git, Azure DevopsProject Management using Agile, ScrumB.S. Degree in a data-centric field (Mathematics, Economics, Computer Science, Engineering or other science field), Information Systems, Information Processing or engineering. Excellent communication & leadership skills, with the ability to lead and motivate team membersAbility to work independently with some level of ambiguity and juggle multiple demands

Thankyou!