Career guides

What does a data engineer do?

A data engineer builds and looks after the systems that collect data, move it between places and prepare it so that analysts and scientists can use it. If an analyst is the person asking questions of the data, a data engineer is closer to the person making sure the data arrives, on time, in a usable shape. The work is closer to software engineering than to reporting.

A typical week

One real decision from the job

Data engineering · sample decision

A daily report was built on a table that sometimes arrives two hours late. The analysts want it by nine every morning.

How would you approach it?

You might add a check that waits for the data, fix the late source, alert someone, or tell the analysts about the limit. Each choice trades speed, reliability and effort differently.

Try a free decision on Compass, which uses a different scenario. It takes a few minutes, and nobody scores you.

Signs you might enjoy it

Signs it might drain you

How to test it in a week

  1. Take two small data files, such as two spreadsheets that share a column, and combine them with a short script or formulas.
  2. Write down every way the result could be wrong, such as duplicates and missing rows, and check for each.
  3. Ask someone who works with data how they learned about a failed load.

Common questions

Do I need a computer science degree?

Many roles ask for programming and database skills, which can be learned in several ways. Read the description for what is actually required.

Where can I read more?

See data analytics vs data engineering and what a software engineer does.

Try the work before you choose it

Compass lets you try a realistic decision from each path you’re weighing, notice how it felt, and choose your next step with evidence. The preview on our home page is free.

Try a free decision

Weighing two or three paths seriously? See our packages, each prepared and reviewed by a person.

Related guides