My First Three Weeks as a Data Engineering Manager

It’s officially been three weeks since I’ve started my new role as the data engineering manager at Vox Media.

Other than the work I’ve been doing to feel through ongoing projects and processes, I’ve been having fun articulating and ideating ways to make major wins for our data team. In this post, I’d love to share my thoughts on the importance of Data Science teams and how you can also begin to define a data strategy moving forward.

Why does your team exist?

We exist to…

Provide Vox Media stakeholders with democratized and integrated data solutions to gain clarity, insights, and scale on first-party data.

Our vision is to…

Become a world-class data engineering team leading the way in developing production-ready and state-of-the-art data science solutions.

We do this by…

We stay curious, share what we know, support our team members, celebrate our successes, and learn from setbacks.

My first week at work involved meeting all the amazing people making these goals possible. In the world of software technologies, the software solutions we build are meant to be useful, loved, and impactful. Our code doesn’t exist to live in silos, never to be seen or understood. Bringing a team together means understanding that there are so many pieces to the journey of delivering valuable software solutions. And that this journey is cross-functional.

Get Clear on the Details

Understanding the skills and functions needed to build fully democratized and integrated projects isn’t easy, especially when it comes to building teams (such as data science teams) where there is no industry standard for specific roles. How do we define a Data Engineer vs. a Machine Learning Engineer vs. a Machine Learning Researcher?

I began articulating these concepts as a means to have more discussions on perspectives that traditional teams across organizations may not realize as it relates to building team compositions that are quite different from the standard Software Engineering team (those as we’ve seen with DevOps and SRE Team Toplogies that even this is ever-changing). My ideas needed to acknowledge the technical contributors of the data team and the subject matter experts that help make our projects and ideas tangible. How do we have all stakeholders begin to understand and respect the priorities, skills, and differences that come with having different roles, backgrounds, and values? And What does this look like when the sum of the parts comes together?

I began to define these pieces and clarify as time went on. There are examples of amazing data science teams that also give back to the community through research publications, available datasets, and open-sourced solutions. Facebook Ai, LinkedIn, and Mozilla all have great data science teams. If our vision is to become world-class, there are certain and standards to be met.

I come from a DevOps background, where we’re often stuck in (sometimes transient) terminology, asking each other what is DevOps, What is SRE, What is GitOps, or What is Progressive Delivery? But, if we can focus on the buckets and areas of expertise, we can begin to have the right roles and capabilities for different projects on our team. I strove to also think about the current talent gap in the data science space, how we have over 21 million software developers in the world, but not nearly as many that understand and work on data solutions.

I ask these pointed questions not only in this post but also to my community and team. These discussions and conversations are what make new teams more well-rounded, inclusive, and successful.

Scale Further

I shared our team’s vision and mission statements earlier in this article because I am passionate about these outcomes. Sharing and defining this with my team was one of the first actions I took as the new manager. In modern software development, autonomy is how we can sustainably and reasonably scale to meet software demands. The contributors decide what to work on and when to get it done. As a manager, I’m here to support as best as I can.

Conclusion

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Tiffany Jachja

Software engineering manager covering topics on software, personal development, and career.