Sr. Data Engineer | Minnestar

Total Expert
We are looking for a Senior Data Engineer to join our growing Software Engineering organization. As a member of our growing Data Engineering team, you’ll use cutting edge AWS technologies and leverage your experience with data and data technologies to build out our fast-growing data and analytics platform that serves both our internal team members and our customers.
The team is comprised of Data and UI engineers working to bring our big data platform into the future.  Working with both Data Bricks as a backend and Sisence for our embedded reporting and visualization tool. We are looking for people to help us provide more data to our internal and external customers.  If you like ETL / Terraform / glue / AWS that’s our jam.  If you have experience with either Data Bricks or Sisence, that would be great, but those are not critical.
We’re looking for someone who is passionate about data, databases, and all things in between and can bring their experience around best practices and effective technology approaches for moving, assembling, and creating value with data within a cloud-based SaaS platform.
You’’ll contribute to helping architect our new back end in Data Bricks. You also help create models and analytics schemas for several different types of use – between custom reporting, data transfers to customers, and ML/AI work.
This is a remote position with the option of hybrid work for candidates local to MN.

What You’ll Do

    • Develop batch and streaming data pipelines using modern data architecture and technologies such as Spark, AWS Glue, Amazon Kinesis, Lambda, and Databricks
    • Leverage CI/CD practices to deploy and maintain data pipelines
    • Collaborate with data analysts and product designers to gather and refine analytics requirements and translate requirements into technical designs
    • Create data models to support complex internal and customer facing analytics and reporting use cases and advise/educate data analysts and business users on the benefits of various models
    • Design and implement process improvements for better quality, performance, scalability, and automation
    • Create automated tests to validate and improve data quality and pipeline reliability
    • Support and maintain production data pipelines including troubleshooting and performance tuning of Spark, SQL, and Python modules
    • Assist data analysts with query writing and tuning
    • Mentor team members on technology, patterns, and best practices
    • Participate in team-based knowledge sharing opportunities and contribute to the overall growth and collective knowledge of Total Expert’s Data Engineering team

What We Look For

    • 5+ years of experience developing large-scale data pipelines using cloud-based technology and distributed storage/processing platforms such as S3, HDFS, AWS Glue, Spark and Hadoop in a production environment
    • 3+ years of experience with Amazon Web Services environments and technologies such as Glue, Athena, S3, Lambda, SNS, SQS, and Kinesis
    • Action-oriented, collaborative, and iterative mindset
    • Adaptability and flexibility
    • Working knowledge of data warehouse dimensional modeling techniques/patterns and experience with data warehouse SaaS platforms such as Redshift and Snowflake
    • Intermediate to advanced level of Python expertise
    • Advanced to expert level SQL knowledge and ability to write and decipher complex, multi-part queries
    • Team based Agile/Scrum development experience using tooling such as Jira, Git, etc.

Preferred Qualifications:

    • 2+ years of experience building data pipelines using Databricks and Spark (PySpark preferred)
    • Experience with Sisence
#LI-NS1 #LI-Remote
Company Mission & Vision:
Total Expert’s mission is to empower modern financial institutions to create trusted lifelong customer relationships. Our vision is to orchestrate the perfect customer journey across modern financial services by creating the leading purpose-built platform.
Total Wellness:
We believe that living a balanced life leads to more creativity and productivity. Total Expert offers the following benefits to support employees in their pursuit of Total Wellness.
Physical Wellness:
• Medical, Dental & Vision Coverage
• Prescription Drug Coverage
• GymPass
• Health Advocate Program
• Flexible Time Off Program
Financial Wellness:
• 401(k) Retirement Savings Plan & Matching Program
• Health Savings Account, Flexible Spending Accounts & Disability Protection
• Life & Voluntary Life Coverage
• Paid Parental Leave
• Pet Insurance
• Employee Referral Bonus
Our Pledge:
We believe that strength comes from diversity and we strive for a culture where every person’s voice, unique lived experience, and talents are embraced and celebrated. We are committed to attracting and hiring for diversity of all kinds, creating better opportunities for inclusion and belonging throughout our employee lifecycle, and establishing and/or refining our internal practices and procedures to ensure equity.
About Us:
Total Expert is a pre-IPO, series C, $50M (annual recurring revenue) fintech company. We are growing fast (between 30-40% annually), and as a CRM and marketing automation platform purpose-built for lenders and banks, we enjoy a tremendous product market fit for the world-class financial institutions we serve.
The Total Expert platform unifies data, marketing, sales, and compliance solutions to provide a cohesive experience across the customer lifecycle. We are determined to reimagine the way people and technology work together so that our customers build more meaningful, human connections with their customers.
Innovation Path:
With 1/3 of our annual budget committed to R&D, Total Expert is executing on a platform modernization journey, which has allowed us to focus on: team autonomy, continuous integration and deployment, and building the architectural foundation for the future. The results so far? 1) We moved from monthly deployment to multiple times per day, 2) our teams are empowered to make decisions and lead the architecture of their domain, and 3) we’ve built an event-sourced backbone as the foundation to build enterprise services with velocity.
Industry Leader:
Amidst business and integration growth, Total Expert continues to receive several awards and industry recognition. G2, the world’s leading business solutions review website, has identified Total Expert as a leader across four categories in the Summer 2022 reports. These rankings were achieved based on market presence and customer satisfaction of real users, which were then compared to similar products in each report category.
Along with this achievement, Total Expert recently has been recognized with the following awards and honors:
-Named to the 2022 Inc. 5000 Series: Midwest list for the third consecutive year
-Named a finalist in the “Best Consumer Digital Banking Solution Provider” category of the Banking Tech Awards USA
-Listed as the fifteenth largest software company in the Twin Cities on the MSP Biz Journal – Software Development List
-Listed as an honoree for one of the most innovative technology companies in the housing economy on HousingWire’s 2022 Tech100 list for the fifth consecutive year
-Listed as number seven on the list of the 2022 Best Tech Startups in Minnesota
Come Join Us:
We’re changing how financial institutions engage with consumers, and it starts with the people behind our platform. We’re seeking passionate individuals to grow with us as we continue to empower leading financial brands to form deeper customer relationships. Our most successful people have a “teamwork makes the dream work” mindset, operate with a strong sense of urgency, have an entrepreneurial spirit, and are solutions-oriented. Take a closer look!
Job Type: Full-time
Compensation Type: Salaried
Location: Remote
Posted by Total Expert on November 7, 2022