Spark Developer A custom development company, MentorMate is a design and software powerhouse with mature and established practices in Enterprise Web & Mobile Development, Human-Centered Design, Cloud & DevOps, Advanced Data Мanagement & Analytics. For our Data & Analytics Center of Excellence (DCOE) we are looking to hire an experienced Spark Developer. As a Spark Developer in DCOE, your primary goal will be to offer non-standard solutions and unlock the potential of our clients. Through expert-level data management and analysis, the DCOE team facilitates resource management, database migration to new engine types, data unification, and company mergers. SQL reports optimization, Business Intelligence reports, and troubleshooting of data flows are another significant part of our day-to-day responsibilities. Our software solutions tackle specific tech challenges across several industries. While our roots are in education, nearly half of our current projects are focused on healthcare. We also innovate in finance, real estate, commerce, IoT, and others. As a top engineering employer, run by engineers, MentorMate provides challenging careers in a friendly, people-oriented environment. We value our employees and share our success through competitive pay and benefits, advancement opportunities, and flexible working models. Responsibilities Align architecture with business requirements Analyze, re-architect, and re-platform data warehouses Guide strategic customers as they implement transformational big data projects, including end-to-end design, build and deployment of industry-leading big data and AI applications Identify ways to improve data reliability, efficiency, and quality Develop, construct, test, and maintain data pipelines for multiple analytics functions Use your expertise in data engineering best practices to guide customers to do the same Requirements 3+ years of experience with databases and data warehousing 3+ years of experience with ETL, data modeling, and data architecture Experience in using of Python/ PySpark and/or Scala for data engineering Experience with any Big Data technologies such as Databricks, Spark, Hadoop, Kafka, Flink, Storm Кnowledge on Apache Spark internals Experience in developing simple Spark notebooks to analyze customer usage data Experience in operating very large data warehouses or data lakes Experience with building data pipelines and applications to stream and process large datasets at low latencies AWS/ Azure or OCI Ability and desire to learn new languages and technologies Attention to detail and strong documentation skills Fluent English both written and verbal A significant advantage would be an experience with SQL/SparkSQL/Python/PySpark/Scala ETL tools like Airflow, Talend, Mattilion, Informatica, ODI, SSIS Delta Lake and MLflow Oracle, MS SQL Server, MySQL, PostgreSQL, AWS Redshift, Azure Synapse, Snowflake, DynamoDB Designing and implementing batch and stream data processing pipelines Certification of SQL, PL/SQL, T-SQL, Python, Databricks Posting Summary Job role Engineering & TechnologyData Engineering Experience Level Regular Employment Type Full - time Location SofiaPlovdivBulgaria RemoteVarnaVeliko TarnovoRuse Apply now Posting Summary Job role Engineering & TechnologyData Engineering Experience Level Regular Employment Type Full - time Location SofiaRemotePlovdivBulgaria RemoteBulgariaVarnaVeliko TarnovoRuse Apply now We offer Flexible Benefits Professional Growth Clear career path, meaningful projects, tech innovations. Regular Salary Raises Following the curve of your career path and performance. Work Where You Want Choose to work remotely, in-office, or a combination of the two. Upskilling Various trainings, knowledge sharing events, personal learning budget. Incentive Programs Rewards for referring employees, sharing knowledge, and more. Additional Insurance Attractive health and dental insurance packages. Extra Days Off The longer you work with us, the more paid leave you get. Transport & Leisure Partial coverage of transport costs, sports passes, takeaway food. Save for the Future Set a retirement plan or start an investment program. Teambuilding Enjoy team gatherings and communities of interest. Giving to Others Take part in various charity and volunteer activities. Mental Wellness Support with a counseling package if needed. Career Development Career Path We strive to provide everyone working at MentorMate with plenty of opportunities to further their career. In fact, we have an entire team dedicated to learning and development to do exactly that. To further aid in individual career growth, we developed the MentorMate Career Path to serve as a roadmap for the professional development of each team member. Moreover, it provides information about the technical and soft skill requirements for upskilling and taking the future steps of the individual professional journey within the company. The Career Path provides opportunities for people to determine their own goals based on how they want to grow and serves as a foundation and reference point for career discussions. It also cultivates a culture of proactiveness regarding personal career growth. Let’s Work Together Related job positions More opportunities in the Engineering & Technology team Software Engineering Manager – Java Bulgaria Bulgaria Remote Full - time Azure Data Consultant Bulgaria Bulgaria Remote Full - time Senior Automation QA with Java/ C#/ TypeScript/ Python – Contractor Global Remote Contractor