We're KSM, one of the top 50 largest independent advisory, tax, and audit firms in the United States. Through our deep experience across multiple disciplines and industries, we provide our clients with the inspiration, insight, and technical expertise they need to achieve great things.
Our firm is rooted in entrepreneurialism and committed to excellence – for our employees, our clients, and our communities. At KSM, you'll be empowered to hone your skills and develop your interests. You'll feel valued and cared for – and challenged – in a fun, collegial environment where you're appreciated as an individual with singular talents. And you'll be rewarded for growing, leading, and innovating. Because our vision for you is that you come to work every day and do your very best work. To be there for your teammates. To best serve our clients. And to realize your full potential as a professional – and as a person.
Headquartered in Indianapolis, we have multiple offices and serve an impressive roster of clients across the nation who count on us to be their trusted advisors.
At Katz, Sapper & Miller (KSM), we are dedicated to leveraging cutting-edge technology to drive innovation and deliver exceptional value to our clients. As a leading accounting and consulting firm, our Innovation Team is at the forefront of integrating advanced data solutions, cloud platforms, and AI technologies to transform business processes and foster growth.
Position Summary: We are seeking an experienced and visionary Senior Data Engineer/Architect to join our Innovation Team. In this role, you will lead the design, development, and implementation of robust data architectures utilizing Databricks and AWS services. Your expertise will be crucial in advancing our data strategy, enabling AI/ML initiatives, and ensuring scalable, secure, and efficient data solutions that support the firm's objectives.
Key Responsibilities: Develop and maintain large-scale data pipelines.Ensure data availability, reliability, traceability, and security in accordance with FAIR data principles.Lead the design and implementation of scalable data pipelines for ingesting, processing, and storing diverse data types.Architect and manage enterprise-level data solutions using Databricks and AWS services, ensuring optimal performance and security.Develop and maintain comprehensive data models, warehouses, and lakehouses to facilitate advanced analytics and reporting.Collaborate with data scientists and AI/ML engineers to support the development and deployment of machine learning models, including generative AI applications.Design and implement infrastructure to facilitate the training, tuning, and deployment of large-scale AI models.Develop and maintain large-scale data pipelinesEnsure data availability, reliability, traceability, and security in accordance with FAIR data principles.Work with users on development, implementation, maintenance, and improvement of use cases.Develop and build optimized and maintainable data architectures and pipeline landscapes for collection, storage, and processing of data.Implement data quality controls and monitor data performance.Stay abreast of emerging AI technologies and assess their applicability to enhance our data and AI capabilities.Partner with cross-functional teams, including data analysts, software engineers, and business stakeholders, to understand data needs and deliver impactful solutions.Provide technical leadership and mentorship to junior data engineers, fostering a culture of innovation and continuous learning.Communicate complex technical concepts to non-technical stakeholders, ensuring alignment and understanding.Implement and enforce best practices for data governance, ensuring compliance with industry standards and regulations.Monitor data quality and integrity, establishing processes for data validation and error handling.Automate and optimize data workflows to enhance efficiency, reliability, and scalability.Troubleshoot and resolve data-related issues promptly, maintaining system health and performance.Required Qualifications Strong understanding of Databricks engineering and best practices for data engineering and analytics. (e.g., autoloader, Delta Lake/lakehouse technology).Proficiency in data programming languages such as Python, SQL, Hive, and Spark.Familiarity with big data frameworks such as Spark.Strong understanding of data lakes/data environments including data modeling, ETL processes, and cloud-based data architectures and systems, such as Airflow – including data catalog (metadata), ETL, API interfaces.Proficiency in AWS services, including but not limited to S3, Glue, Lambda, Redshift, and EMR.7+ years of experience in data engineering, architecture, or a related field, with a focus on large-scale data solutions.Proven track record of leading the design and implementation of complex data architectures.Experience in integrating AI/ML models into data pipelines and deploying AI solutions at scale.Exceptional problem-solving and analytical abilities.Excellent communication and collaboration skills, with the ability to lead and mentor teams.Knowledge of compliance frameworks and best practices in data governance.Experience with Generative AI and large language models, including their deployment and integration into business solutions is a plus.Familiarity with DevOps practices and IoC tools such as Terraform, Pulumi, CloudFormation, and CI/CD pipelines for GitHub, GitLab, Jenkins, or ADO.Knowledge of modern BI tools (e.g., Tableau, Power BI, Looker) and their integration with data platforms.Certifications in AWS and data engineering are highly desirable. We are an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, color, sex, sexual orientation, gender identity, disability, genetic information, national origin, race, religion, veteran status, or any other protected category. KSM only accepts resumes directly submitted by a candidate and referrals submitted by current KSM employees. Unsolicited resumes or candidate profiles sent by staffing agencies and fee-based referral services will not be considered outside of a signed KSM vendor contract. KSM will not pay a fee to recruiters or agencies that do not have a signed KSM vendor contract.