DEV Community

Cover image for Data Engineering 102 ;Introduction to Python for Data Engineering
Kasamba Lumwagi
Kasamba Lumwagi

Posted on • Updated on

Data Engineering 102 ;Introduction to Python for Data Engineering

Commit yourself to learn the basics of python specifically the areas that are related to data Engineering.
You will need Python to be installed in the Operating system that you are using be it Linux, Mac OS, or the most common Windows. These are the topics that you should put more emphasis on:-

1.MATH EXPRESSIONS

Syntax Math Meaning
a+b a+b addition
a-b a-b) subtraction
a*b a\times b\ multiplication
a/b a\div b\, division (see note below)
a//b a\div b\ division - in python 2.2 & abv
a%b a mod b modulo
-a -a negation
abs(a) |a| absolute value
a**b a^{b} exponent
math.sqrt square root

2.Strings
Strings in python are surrounded by either single quotation marks, or double quotation marks.
e.g

'hello' is the same as "hello".

You can display a string literal with the print() function:

for more info :
Link

  1. Variables Variables are containers for storing data values.

A variable is created the moment you first assign a value to it.

x = 5
y = "John"
print(x)
print(y)

for more info:
Link

4.Loops
Python provides three ways for executing the loops

(a)While Loop:
In python, while loop is used to execute a block of statements repeatedly until a given condition is satisfied. And when the condition becomes false, the line immediately after the loop in the program is executed.

while expression:
statement(s)

(b) For in Loop:
For loops are used for sequential traversal. For example: traversing a list or string or array etc. In Python, there is no C style for loop, i.e., for (i=0; i<n; i++). There is β€œfor in” loop which is similar to for each loop in other languages. Let us learn how to use for in loop for sequential traversals

for iterator_var in sequence:
statements(s)

(c)Nested Loops:
Python programming language allows to use one loop inside another loop. Following section shows few examples to illustrate the concept.
Syntax:

while expression:
while expression:
statement(s)
statement(s)

5.Functions.
A function is a block of code which only runs when it is called.

The basic syntax is:
def my_function():
print("Hello from a function")

6.List, Tuples, Dictionary and sets

Its also important to learn how to connect databases with :-
1.BOTO3
2.Psycopg2
3.mysql

Together with the following essentials;-
1). JSON
2). JSONSCHEMA
3). datetime
4). Pandas
5). Numpy.

Top comments (0)