Networks 📝

Networks are the backbone of the modern world, but how do they work? Check the following videos to learn the fundamental about networking.

Network Transmission Principles 📝¶

Network transmission principles are fundamental concepts in networking that govern how data is sent and received across computer networks. These principles are essential for understanding how information flows efficiently and reliably over the internet and other network infrastructures.

Latency¶

Latency refers to the delay or lag that occurs when data is transmitted from one point to another in a network. It can be caused by various factors:

• Serialization and deserialization:

  • Serialization is the process of converting data into a format that can be transmitted over a network.

  • Deserialization is the reverse process.

  • The serialization and deserialization steps introduce overhead, contributing to latency. The more complex the data and the longer the serialization process takes.

• Propagation:

  • Propagation delay in networks refers to the time it takes for data to travel from its source to its destination over a physical medium, such as a network cable or a fibre optic line.

  • In networks, this delay is influenced by the physical distance between devices and the speed at which signals can travel through the medium.

• Switching:

  • When data is sent across a network, it’s broken into smaller packets, and these packets need to find their way to the right destination.

  • Switches make this happen efficiently. They determine the best path for each packet, helping them avoid traffic jams and collisions.

  • To direct packets, switches need to inspect each packet. Each inspection accrues overhead, therefore latency is impacted by both the number of switches each packet passes through, and the speed of those switches.

• Queuing:

  • When lots of data packets arrive at a network device like a router, they might have to wait their turn before they can continue on their journey. This waiting time is called queuing delay.

  • Low queuing delay means faster data transmission, inversely, high queuing delay can slow down data delivery.

Low latency is crucial for real-time applications like video conferencing and online gaming, where delays can lead to a poor user experience.

Jitter¶

Jitter is the variation in the delay of received packets in a network. It represents the inconsistency in the timing of packet arrivals. It can result from network congestion, varying path lengths for different packets, or differences in the processing time at network devices.

In applications like Voice over IP (VoIP) and streaming media, jitter can lead to disruptions and poor audio or video quality. Minimizing jitter is essential for smooth communication.

Quality of Service (QoS) Guarantee¶

Network Quality of Service (QoS) guarantee refers to the assurance that a network can provide specific levels of service and performance to different types of traffic or applications. QoS is critical in ensuring that data, voice, video, and other applications receive the necessary bandwidth, low latency, and minimal packet loss to function effectively.

To guarantee QoS, networks often employ various mechanisms, such as traffic prioritization, bandwidth reservation, and congestion management. For example, in a VoIP (Voice over Internet Protocol) call, QoS guarantee ensures that voice packets are prioritized over less time-sensitive data packets, reducing the chances of voice call degradation due to network congestion.

Timeliness of delivery¶

The principle of timeliness of delivery in networking refers to the requirement that data should be delivered within a timeframe suitable for its intended use. This is crucial for ensuring that the information remains relevant and useful by the time it reaches its destination.

Network Transmission Protocols 📝¶

TCP/IP 📝¶

TCP/IP stands for Transmission Control Protocol / Internet Protocol. It is the core set of communication rules (called a protocol suite) that computers use to send and receive data over networks, including the internet.

Developed in the 1970s, TCP/IP is now the standard for all internet communication.

TCP/IP Protocol Layers

TCP/IP is made up of four layers. Each layer has its own job:

1. Application Layer

   • Deals with applications and user services

   • This is the layer you interact with (e.g., web browsers, email clients)

   • Protocols here:

     • HTTP/HTTPS – web browsing

     • SMTP – sending emails

     • IMAP/POP3 – receiving emails

     • FTP – file transfer

2. Transport Layer

   • Manages the delivery of data

   • Breaks data into chunks (called segments) and reassembles them

   • Handles error checking and flow control

   • Two main protocols:

     • TCP – Reliable, ordered delivery (used for most things)

     • UDP – Faster, no guarantee of delivery (used for games, video calls)

3. Internet Layer

   • Handles routing of data between devices across networks

   • Breaks data into packets and labels them with IP addresses

   • Protocols here:

   • IP – Internet Protocol (IPv4 and IPv6)

   • ICMP – for sending error and control messages (used by ping)

4. Network Access Layer (Link Layer)

   • Manages how data is sent physically over the network (wires, Wi-Fi, etc.)

   • Converts packets into electrical signals or radio waves

   • Protocols: Ethernet, Wi-Fi, ARP

How TCP/IP Works (Step-by-Step)

1. User Action: You enter www.example.com in your browser.

2. DNS Lookup: Your computer gets the IP address for the website using DNS.

3. Data Preparation: Your browser sends an HTTP request (application layer).

4. TCP Adds Reliability: The data is split into segments with error checks.

5. IP Handles Routing: Each segment is wrapped in an IP packet and given a destination IP.

6. Data Sent Over Network: Packets travel through routers and switches.

7. Receiving End: The server reassembles the segments and sends back a response.

8. Browser Displays Page: You see the website once all the data is received.

TCP vs UDP Comparison

What is IP?¶

IP (Internet Protocol) is a network layer protocol that handles addressing and routing of data between devices on a network. It ensures that packets of data are sent from the sender to the correct destination.

Every device on a network — like your phone, laptop, or a website server — is assigned a unique IP address, which acts like a digital address so the internet knows where to send information.

IP is responsible for

1. Addressing

   • Every device must have a unique IP address.

   • IP addresses identify the sender and the receiver of data.

2. Packetization

   • IP splits data into small units called packets.

   • Each packet includes:

     • Sender IP address

     • Destination IP address

     • Other information (e.g. time to live)

3. Routing

• Packets may travel through many routers across different networks.

• Each router checks the destination IP and forwards the packet toward its target.

• The path may not be the same for each packet — they can take different routes.

4. Delivery (Best-Effort)

• IP does not guarantee delivery.

• Packets can be lost, duplicated, or arrive out of order.

• That’s why TCP is often used on top of IP to ensure reliable delivery.

Types of IP Addresses

• IPv4 (Internet Protocol version 4)

  • Most common version

  • Written in 4 numbers separated by dots

  • Example: 192.168.1.1

  • Uses 32 bits, allowing about 4.3 billion addresses

  • Running out of available addresses

• IPv6 (Internet Protocol version 6)

  • Newer version designed to replace IPv4

  • Written in 8 groups of hexadecimal numbers

  • Example: 2001:0db8:85a3:0000:0000:8a2e:0370:7334

  • Uses 128 bits, allowing trillions of addresses

  • Supports more devices and improved security

Static vs Dynamic IP Addresses

IP Header

Every IP packet includes a header with important information:

• Version (IPv4 or IPv6)

• Source IP address

• Destination IP address

• Time to Live (TTL) – how many hops (routers) the packet can go through before being dropped

• Protocol – tells what’s inside (e.g., TCP, UDP)

HTTP / HTTPS 📝¶

HTTP (Hypertext Transfer Protocol) and HTTPS (Hypertext Transfer Protocol Secure) are both protocols used for transferring data between a web browser (client) and a web server. The primary difference lies in security and data protection.

Key Differences

• HTTP is fast and suitable for non-sensitive information, but it is not secure—data can be intercepted or altered by third parties.

• HTTPS is essential for protecting sensitive data, preventing “man-in-the-middle” attacks, and building user trust.

• Modern browsers display a padlock icon for HTTPS sites, signalling a secure connection, and may warn users when a site is not secure.

Basic Workflow

1. Connection Establishment: The client initiates a TCP connection to the server. HTTP typically operates over TCP/IP and uses port 80 for standard HTTP connections.

2. Request-Response Cycle:

   • Request: Once the TCP connection is established, the client sends an HTTP request to the server. This request includes:

     • a request line (method, URL, HTTP version)

     • headers (host, user-agent, content-type, etc.)

     • sometimes a body (for methods like POST or PUT)

   • Response: The server processes the request and sends back an HTTP response. This response contains:

     • a status line (HTTP version, status code, status message)

     • response headers (content-type, content-length, server, etc.)

     • often a body containing the requested resource or data

3. Connection Closure: After the response is delivered, the connection can be closed, or kept open for further requests if the header Connection: keep-alive is used.

   HTTP Methods

• GET: Requests the specified resource. GET requests should only retrieve data and should have no other effect.

• POST: Submits data to be processed (e.g., from a form). The server may create or update resources based on the data provided.

• PUT: Replaces the current target resource with the request payload.

• DELETE: Removes the specified resource.

• HEAD: Similar to GET, but it retrieves only the status line and header section.

• OPTIONS: Describes the communication options for the target resource.

• PATCH: Applies partial modifications to a resource.

Status Codes

HTTP responses come with status codes that indicate the outcome of the request:

• 2xx (Success): Indicates that the client’s request was successfully received, understood, and accepted (e.g., 200 OK, 201 Created).

• 3xx (Redirection): Indicates that further action needs to be taken by the client in order to complete the request (e.g., 301 Moved Permanently, 302 Found).

• 4xx (Client Error): Indicates an error that seems to have been caused by the client (e.g., 404 Not Found, 403 Forbidden).

• 5xx (Server Error): Indicates an error on the server side (e.g., 500 Internal Server Error, 503 Service Unavailable).

FTP / FTPS 📝¶

FTP

FTP stands for File Transfer Protocol. It’s one of the oldest protocols used to transfer files between two computers over a TCP/IP network (like the internet).

How It Works:

• FTP uses a client-server model.

  • The FTP client is the program you use to connect (e.g. FileZilla, Cyberduck, or even a terminal command).

  • The FTP server hosts files and handles file transfer requests.

• To connect, you provide:

  • A server address (like ftp.example.com)

  • A username and password

• Once connected, you can:

  • Browse directories

  • Upload files from your computer to the server

  • Download files from the server to your computer

  • Rename, delete, or move files

Security FTP is not secure by default:

• Your username and password are sent in plain text.

• Files are transferred without encryption.

• Anyone using a network sniffer (like Wireshark) could intercept and read your data.

FTPS

FTPS stands for FTP Secure or FTP over SSL/TLS.

• It adds encryption using SSL (Secure Sockets Layer) or TLS (Transport Layer Security).

• The encryption protects:

  • Login credentials

  • File data during transfer

• FTPS supports both:

  • Implicit FTPS (uses port 990; encryption starts immediately)

  • Explicit FTPS (uses port 21; client asks for encryption after connecting)

Benefits of FTPS:

• Secure transmission of sensitive files (e.g. medical data, financial documents)

• Authentication using certificates (optional, for extra security)

• Often used by businesses and government systems that require encrypted file transfer

VPN¶

A VPN (Virtual Private Network) keeps your internet connection private and secure. It uses protocols to create a safe tunnel for your data.

Here are the most common VPN protocols:

• PPTP (Point-to-Point Tunneling Protocol)

  • Very old and fast

  • Easy to set up

  • Weak security — not recommended

• L2TP/IPsec

  • Combines two protocols for better security

  • Safer than PPTP

  • Slower, but more secure

• OpenVPN

  • Very secure and reliable

  • Can work on most networks

  • A bit slower but very safe

• IKEv2/IPsec

  • Fast and stable

  • Great for phones and tablets

  • Handles switching Wi-Fi and mobile data well

• WireGuard

  • New and very fast

  • Uses strong, modern security

  • Still being adopted by some platforms

Streaming 📝¶

Streaming protocols are rules that control how audio and video are sent over the internet so that people can watch or listen in real time without downloading the entire file first.

There are two main types:

• Live streaming – real-time content like live events or games

• On-demand streaming – videos or music you can play anytime (e.g. YouTube, Netflix)

Common Streaming Protocols

• HTTP Live Streaming (HLS)

  • Created by Apple

  • Breaks video into small chunks and sends them one at a time

  • Works well on phones, computers, and smart TVs

  • Can change quality depending on your internet speed (adaptive streaming)

• Dynamic Adaptive Streaming over HTTP (MPEG-DASH)

  • Similar to HLS but not Apple-specific

  • Also uses small chunks and adaptive quality

  • Works across many devices and platforms

• Real-Time Messaging Protocol (RTMP)

  • Older protocol made by Adobe

  • Used for low-latency (fast) live streaming

  • Often used to send live video from streamers to platforms like Twitch or YouTube

• WebRTC (Web Real-Time Communication)

  • Used for real-time communication like video calls (e.g., Zoom or Google Meet)

  • Very low latency (almost no delay)

  • Doesn’t need extra plugins or apps—works in modern browsers

Broadcasting 📝¶

Broadcast protocols are ways of sending data from one device to many devices at once on a network. They are used when the same message needs to reach a group of devices without sending it separately to each one.

How Broadcasting Works

• In a broadcast, data is sent to all devices on a local network. Each device checks the message to see if it’s meant for them.

• Broadcasting is usually only used in Local Area Networks (LANs)—not across the internet—because it creates a lot of traffic if overused.

Common Broadcast Protocols

• ARP (Address Resolution Protocol)

  • Used to find the MAC address of a device when you only know its IP address

  • Sends a broadcast message to the whole network asking, “Who has this IP?”

• DHCP (Dynamic Host Configuration Protocol)

  • Used to assign IP addresses to devices automatically

  • When a new device connects to the network, it broadcasts a message asking for an IP address

  • A DHCP server responds with an available address

• NetBIOS

  • Used in older Windows networks to share files and printers

  • Broadcasts names of devices to find others on the local network

Data Exchange Methods 📝¶

REST (Representational State Transfer) 📝¶

REST is an architectural style for designing networked applications. It relies on a stateless, client-server, cacheable communications protocol — the HTTP (Hypertext Transfer Protocol).

RESTful systems use HTTP requests to perform CRUD (Create, Read, Update, Delete) operations on resources.

Key Concepts

• Resources: Resources are typically data objects or services and can be accessed using a unique URL.

• HTTP Methods: REST uses standard HTTP methods to perform operations on resources.

• Stateless Communication: The server does not store any state about the client session on its end, therefore each request from a client to a server must contain all the information the server needs to understand and process the request.

• Representation: Resources are represented in different formats, usually JSON (JavaScript Object Notation) or XML (eXtensible Markup Language).

  • The client requests a resource and the server responds with the resource’s current state in one of these formats.

Example of Data Exchange Using REST:

• GET Request:

  • A client wants to retrieve information about a book with the ID 123.

  • The client sends a GET request to the server at the URL: http://api.library.com/books/123.

    • The server responds with the book’s details in JSON format:

    {
      "id": 123,
      "title": "Introduction to Programming",
      "author": "John Doe",
      "year": 2020
    }

• POST Request:

  • A client wants to add a new book to the library.

  • The client sends a POST request with the book’s data to the URL: http://api.library.com/books.

  • The server processes the request and adds the book to the database, responding with the created book’s details:

    {
      "id": 124,
      "title": "Advanced Programming",
      "author": "Jane Smith",
      "year": 2021
    }

• PUT Request:

  • A client wants to update the information of an existing book with the ID 123.

  • The client sends a PUT request with the updated data to the URL: http://api.library.com/books/123.

    • The server updates the book information and responds with the updated details:

    {
      "id": 123,
      "title": "Introduction to Programming - 2nd Edition",
      "author": "John Doe",
      "year": 2022
    }

• DELETE Request:

  • A client wants to delete a book with the ID 123.

  • The client sends a DELETE request to the URL: http://api.library.com/books/123.

  • The server deletes the book and confirms the deletion:

    {
      "message": "Book with ID 123 has been deleted."
    }

JSON 📝¶

JSON (JavaScript Object Notation) is a lightweight data interchange format that is easy for humans to read and write, and easy for machines to parse and generate. It’s widely used in web applications to send and receive data between a server and a client.

Key Features of JSON

• Simplicity:

  • JSON syntax is straightforward and easy to understand.

  • It is text-based, making it readable for humans.

• Language Independence:

  • Although it originates from JavaScript, JSON is language-agnostic.

  • It is supported by most programming languages, either natively or through libraries.

• Lightweight:

  • JSON data is compact and can be easily transmitted over networks, making it efficient for data exchange.

JSON Structure

JSON data is represented as key-value (called dictionaries in Python) pairs organized in a hierarchical structure. The basic building blocks of JSON are:

• Objects:

  • Enclosed in curly braces {}.

  • Contain a set of key-value pairs.

  • Keys are strings, and values can be strings, numbers, objects, arrays, true, false, or null.

    • Example:

    {
      "name": "John Doe",
      "age": 30,
      "isStudent": false
    }

• Arrays:

  • Enclosed in square brackets [].

  • Contain a list of values.

    • Values can be of any JSON data type.

    • Example:

    {
      "students": ["Alice", "Bob", "Charlie"]
    }

• Values:

  • Can be strings, numbers, objects, arrays, Booleans (true or false), or null.

  • Strings are enclosed in double quotes.

  • Numbers can be integers or floating-point.

  • Example:

    {
      "name": "John Doe",
      "age": 30,
      "height": 5.75,
      "isStudent": false,
      "courses": null
    }

JSON Example

Here’s a complete example representing a student record:

{
  "student": {
    "id": 12345,
    "name": "John Doe",
    "age": 21,
    "isEnrolled": true,
    "courses": [
      {
        "courseName": "Mathematics",
        "courseCode": "MATH101",
        "credits": 3
      },
      {
        "courseName": "English Literature",
        "courseCode": "ENG201",
        "credits": 4
      }
    ],
    "contact": {
      "email": "john.doe@example.com",
      "phone": "555-1234"
    }
  }
}

JSON usage

• APIs: JSON is commonly used in RESTful APIs to exchange data between clients and servers.

• Configuration Files: Many software applications use JSON for configuration due to its readability and ease of parsing.

• Data Storage: JSON can be used to store data in databases, especially in NoSQL databases like MongoDB.

• Web Development: Web applications use JSON to transmit data asynchronously between the server and the client, often with technologies like AJAX.

JSON advantages

• Readability: JSON is easy to read and write for humans, making it straightforward to debug and understand.

• Lightweight: JSON’s simple syntax results in smaller data sizes compared to XML, which reduces the bandwidth needed for data transfer.

• Language Independence: JSON is language-agnostic and can be parsed and generated by many programming languages, including JavaScript, Python, Java, and many others.

• Integration with JavaScript: JSON is native to JavaScript, making it highly efficient for web applications and seamless integration with web technologies.

• Structured Data: JSON’s hierarchical structure allows for the representation of complex data relationships, making it suitable for a wide range of applications, from simple to complex data interchange formats.

• Support for Data Types: JSON supports common data types such as strings, numbers, arrays, objects, Booleans, and null, providing flexibility in data representation.

• Widespread Adoption: JSON is widely supported by web services and APIs, making it a standard choice for data exchange in modern web development.

JSON disadvantages

• Limited Data Types: JSON supports only a few basic data types (strings, numbers, Booleans, arrays, and objects), which may not be sufficient for more complex data representations.

• No Schema Validation: JSON lacks a built-in schema, which can lead to data consistency issues since there is no enforced structure, making it challenging to validate the data format.

• Verbose for Complex Structures: While lightweight for simple data, JSON can become verbose and less efficient for very complex or deeply nested structures, leading to increased parsing and processing time.

• Security Vulnerabilities: JSON parsing, especially in JavaScript, can be susceptible to security risks such as injection attacks if not properly sanitized and validated.

• Binary Data Handling: JSON is not suitable for directly handling binary data, often requiring encoding (like Base64) which increases the size of the data.

• Lack of Comments: JSON does not support comments, making it harder to document or annotate data within the JSON itself for future reference or understanding.

XML 📝¶

XML (eXtensible Markup Language) is a versatile and widely-used format for storing and transporting data. Unlike JSON, which is primarily used for data interchange, XML is more commonly used for document storage, configuration files, and data interchange in enterprise systems.

Key Features of XML

• Self-Descriptive:

  • XML documents are self-descriptive, meaning they include metadata about the data they contain.

  • Each element is identified by a tag, making it clear what data is being represented.

• Hierarchical Structure:

  • XML documents have a tree-like structure with nested elements.

  • This hierarchical nature makes it easy to represent complex data relationships.

• Extensibility:

  • XML is extensible, allowing users to define their own tags.

  • This flexibility makes XML suitable for a wide range of applications.

• Human and Machine Readable:

  • XML documents are both human-readable and machine-readable.

  • They use plain text, making it easy to view and edit with a simple text editor.

XML Structure

• Elements:

  • Enclosed in opening and closing tags <tag> and </tag>.

  • Can contain text, attributes, other elements, or a combination of these.

  • Example:

    <book>
      <title>Introduction to Programming</title>
      <author>John Doe</author>
      <year>2020</year>
    </book>

• Attributes:

  • Provide additional information about elements.

  • Placed within the opening tag of an element.

  • Example:

    <book id="123">
      <title>Introduction to Programming</title>
      <author>John Doe</author>
      <year>2020</year>
    </book>

• Prolog:

  • The prolog is an optional part of the XML document that can contain an XML declaration and processing instructions.

  • The XML declaration specifies the version of XML and the character encoding used in the document.

  • Example:

    <?xml version="1.0" encoding="UTF-8"?>

XML Example

Here’s a complete example representing a student record in XML:

<?xml version="1.0" encoding="UTF-8"?>
<student>
  <id>12345</id>
  <name>John Doe</name>
  <age>21</age>
  <isEnrolled>true</isEnrolled>
  <courses>
    <course>
      <courseName>Mathematics</courseName>
      <courseCode>MATH101</courseCode>
      <credits>3</credits>
    </course>
    <course>
      <courseName>English Literature</courseName>
      <courseCode>ENG201</courseCode>
      <credits>4</credits>
    </course>
  </courses>
  <contact>
    <email>john.doe@example.com</email>
    <phone>555-1234</phone>
  </contact>
</student>

XML usage

• Document Storage: XML is often used to store configuration files and data files.

• Data Interchange: XML is used to exchange data between different systems and platforms.

  • Example: Web services often use XML-based protocols like SOAP (Simple Object Access Protocol) to communicate.

• RSS Feeds: XML is used to create RSS feeds, which are used to distribute updated content from websites.

  • Example: News websites and blogs often provide RSS feeds in XML format.

• Document Formats XML serves as the basis for various document formats.

XML advantages

• Versatility: XML can represent complex data structures and is suitable for a wide range of applications.

• Standardization: XML is a W3C standard, ensuring consistency and interoperability across different systems.

• Self-Descriptive: XML documents are self-descriptive, making them easy to understand and maintain.

XML Disadvantages

• Verbosity: XML can be quite verbose, leading to larger file sizes compared to more concise formats like JSON.

• Parsing Overhead: XML parsing can be computationally intensive, especially for large documents.

CSV & TSV¶

CSV (Comma-Separated Values) and TSV (Tab-Separated Values) are both formats used for storing and exchanging tabular data in a plain text format. In a CSV file, each line corresponds to a row of data, and each value in the row is separated by a comma. TSV is similar to CSV, but instead of commas, tabs are used to separate values.

CSV & TSV Key Features

• Simplicity:

  • Easy to read and write by both humans and machines.

• Compatibility:

  • Supported by most spreadsheet programs like Microsoft Excel, Google Sheets, and database management systems.

• Flexibility:

  • Can store data of various types, including text and numbers.

• Plain Text:

  • Data is stored in a simple text format, making it easy to handle and manipulate.

• Data Import/Export:

  • These formats are commonly used for importing and exporting data in and out of databases, spreadsheets, and other data management systems.

CSV Structure

• Header Row: Often includes column names.

• Data Rows: Each row contains data fields separated by commas.

• Optional Quotes: Fields that contain commas, line breaks, or quotes are enclosed in double quotes

CSV Example

Name, Age, City
Alice, 30, New York
Bob, 25, Los Angeles
Charlie, 35, "San Francisco, CA"

• The header row specifies the columns: Name, Age, City.

• Each subsequent row contains the corresponding data for each column.

• The field “San Francisco, CA” is enclosed in double quotes to handle the comma within the data.

TSV Structure

• Header Row: Often includes column names.

• Data Rows: Each row contains data fields separated by tabs.

• Plain Text: Fields generally do not need to be enclosed in quotes.

TSV Example

Name    Age    City
Alice    30    New York
Bob    25    Los Angeles
Charlie    35    San Francisco, CA

• The header row specifies the columns: Name, Age, City.

• Each subsequent row contains the corresponding data for each column.

• Tabs are used as delimiters, and no special handling is required for fields with commas.

Key Differences

• Delimiter: CSV uses commas, while TSV uses tabs.

• Field Handling: CSV may require quotes for fields with special characters; TSV generally does not.

Advantages of CSV and TSV

• Simplicity and Readability: Files are easy to read and write by both humans and machines.

• Wide Compatibility: Files are supported by a vast array of software applications, including spreadsheet programs like Microsoft Excel and Google Sheets, database management systems, and various data analysis tools.

• Lightweight: Files are typically smaller in size compared to other formats like XML or JSON, which makes them efficient for storage and transfer, particularly over networks.

• Ease of Use: Creating, editing, and parsing CSV files requires minimal resources and can be done with basic text editors and programming languages.

• TSV files avoid delimiter conflicts: Using tabs as delimiters in TSV files reduces the risk of conflicts with data values that might contain commas, making it easier to parse without requiring special handling for embedded delimiters.

• TSV Compatibility: TSV files are not as universally supported as CSV, but are still compatible with many spreadsheet applications and text editors.

Disadvantages of CSV and TSV

• Lack of Standardization: There is no universal standard for CSV and TSV files, leading to inconsistencies in how different applications handle delimiters, line breaks, and special characters.

• Limited Data Types: CSV and TSV files can only store plain text, which limits their ability to represent more complex data types such as binary data, hierarchical data, or objects.

• Delimiter Conflicts: For CSV files fields containing commas must be enclosed in quotes, which can complicate parsing and data entry. Additionally, if the data itself contains quotes or line breaks, it requires additional escaping. For TSV files, data that contains tabs can complicate parsing and require special handling.

• No Support for Metadata: CSV files do not include metadata about the data, such as data types, schema information, or encoding, making it difficult to ensure data integrity and consistency.

• Scalability Issues: For very large datasets, both CSV and TSV formats can become inefficient in terms of processing speed and memory usage, as they require reading the entire file into memory for manipulation.

• Lack of Data Validation: Both formats lack built-in mechanisms for data validation, which can lead to inconsistencies and errors if the data is not carefully managed and validated externally.

• No Support for Hierarchical Data: Both CSV and TSV are flat-file formats and do not support hierarchical or nested data structures, limiting their use for complex data representations.