Pandas - Window Functions (rolling, expanding)
Window functions differ fundamentally from groupby() operations. While groupby() aggregates data into fewer rows, window functions maintain the original DataFrame shape while computing statistics…
Pandas
Data manipulation and analysis with Python's Pandas library. DataFrames, grouping, merging, and cleaning real-world datasets.
Pandas - Write DataFrame to CSV (to_csv)
• The to_csv() method provides extensive control over CSV output including delimiters, encoding, column selection, and header customization with 30+ parameters for precise formatting
Pandas - Write DataFrame to Excel (to_excel)
The to_excel() method provides a straightforward way to export pandas DataFrames to Excel files. The method requires the openpyxl or xlsxwriter library as the underlying engine.
Pandas - Write DataFrame to JSON (to_json)
The to_json() method converts a pandas DataFrame to a JSON string or file. The simplest usage writes the entire DataFrame with default settings.
Pandas - Write DataFrame to Parquet
• Parquet format reduces DataFrame storage by 80-90% compared to CSV while preserving data types and enabling faster read operations through columnar storage and built-in compression
Read more →Pandas - Write DataFrame to SQL Database
SQLite requires no server setup, making it ideal for local development and testing. The to_sql() method handles table creation automatically.
Pandas: Working with DateTime
Time-based data appears everywhere: server logs, financial transactions, sensor readings, user activity streams. Yet datetime handling remains one of the most frustrating aspects of data analysis….
Read more →Pandas - str.slice() - Substring Operations
The str.slice() method operates on pandas Series containing string data, extracting substrings based on positional indices. Unlike Python’s native string slicing, this method vectorizes the…
Pandas - str.split() and Expand to Columns
• The str.split() method combined with expand=True directly converts delimited strings into separate DataFrame columns, eliminating the need for manual column assignment
Pandas - str.startswith() and str.endswith()
The str.startswith() and str.endswith() methods in pandas provide vectorized operations for pattern matching at the beginning and end of strings within Series objects. These methods return…
Pandas - str.strip()/lstrip()/rstrip()
• str.strip(), str.lstrip(), and str.rstrip() remove whitespace or specified characters from string ends in pandas Series, operating element-wise on string data
Pandas - to_datetime() Convert String to Datetime
• pd.to_datetime() handles multiple string formats automatically, including ISO 8601, common date patterns, and custom formats via the format parameter using strftime codes
Pandas - Transpose DataFrame
• Transposing DataFrames swaps rows and columns using the .T attribute or .transpose() method, essential for reshaping data when features and observations need to be inverted
Pandas - Value Counts with Examples
The value_counts() method is a fundamental Pandas operation that returns the frequency of unique values in a Series. By default, it returns counts in descending order and excludes NaN values.
Pandas - Vectorized Operations vs Apply
Vectorization executes operations on entire arrays without explicit Python loops. Pandas inherits this capability from NumPy, where operations are pushed down to compiled C code. When you write…
Read more →Pandas - str.extract() with Regex
The str.extract() method applies a regular expression pattern to each string in a Series and extracts matched groups into new columns. The critical requirement: your regex must contain at least one…
Pandas - str.findall() with Regex
• str.findall() returns all non-overlapping matches of a regex pattern as lists within a Series, making it ideal for extracting multiple occurrences from text data
Pandas - str.get() - Get Character by Position
The str.get() method in pandas accesses characters at specified positions within strings stored in a Series. This vectorized operation applies to each string element, extracting the character at…
Pandas - str.len() - Get Length of String
• The str.len() method returns the character count for each string element in a Pandas Series, handling NaN values by returning NaN rather than raising errors
Pandas - str.lower()/upper()/title()
Pandas provides three primary case transformation methods through the .str accessor: lower() for lowercase conversion, upper() for uppercase conversion, and title() for title case formatting….
Pandas - str.pad()/zfill() - Pad Strings
• str.pad() offers flexible string padding with configurable width, side (left/right/both), and fillchar parameters, while str.zfill() specializes in zero-padding numbers with sign-aware behavior
Pandas - str.replace() with Examples
The str.replace() method operates on Pandas Series containing string data. By default, it treats the search pattern as a regular expression, replacing all occurrences within each string.
Pandas - String Methods (str accessor) Overview
Pandas Series containing string data expose the str accessor, which provides vectorized implementations of Python’s built-in string methods. This accessor operates on each element of a Series…
Pandas: String Operations Guide
Text data is messy. Customer names have inconsistent casing, addresses contain extra whitespace, and product codes follow patterns that need parsing. If you’re reaching for a for loop or apply()…
Pandas - Sort by Index (sort_index)
The sort_index() method arranges DataFrame rows or Series elements based on index labels rather than values. This is fundamental when working with time-series data, hierarchical indexes, or any…
Pandas - Sort by Multiple Columns
• Pandas provides multiple methods for multi-column sorting including sort_values() with column lists, custom sort orders per column, and performance optimizations for large datasets
Pandas - Sort DataFrame by Column (sort_values)
• The sort_values() method is the primary way to sort DataFrames by one or multiple columns, replacing the deprecated sort() and sort_index() methods for column-based sorting
Pandas - Sort in Descending Order
The sort_values() method is the primary tool for sorting DataFrames in pandas. Setting ascending=False reverses the default ascending order.
Pandas - Stack and Unstack
• Stack converts column labels into row index levels (wide to long), while unstack does the reverse (long to wide), making them essential for reshaping hierarchical data structures
Read more →Pandas - str.cat() - Concatenate Strings
The str.cat() method concatenates strings within a pandas Series or combines strings across multiple Series. Unlike Python’s built-in + operator or join(), it’s vectorized and optimized for…
Pandas - str.contains() with Examples
The str.contains() method checks whether a pattern exists in each string element of a pandas Series. It returns a boolean Series indicating matches.
Pandas - Select Rows Containing String
The most straightforward method to select rows containing a specific string uses the str.contains() method combined with boolean indexing. This approach works on any column containing string data.
Pandas - Select Rows Using isin()
• The isin() method filters DataFrame rows by checking if column values exist in a specified list, array, or set, providing a cleaner alternative to multiple OR conditions
Pandas - Select Rows Where Column Equals Value
Boolean indexing is the most straightforward method for filtering DataFrame rows. It creates a boolean mask where each row is evaluated against your condition, returning True or False.
Read more →Pandas - Select Rows with Multiple Conditions (AND/OR)
The most common approach uses bitwise operators: & (AND), | (OR), and ~ (NOT). Each condition must be wrapped in parentheses due to Python’s operator precedence.
Pandas - Select Single Column from DataFrame
The most common approach to selecting a single column uses bracket notation with the column name as a string. This returns a Series object containing the column’s data.
Read more →Pandas - Select Top N Rows by Column Value (nlargest)
The nlargest() method returns the first N rows ordered by columns in descending order. The syntax is straightforward: specify the number of rows and the column to sort by.
Pandas - Set DatetimeIndex
Time-series data without proper datetime indexing forces you into string comparisons and manual date arithmetic. A DatetimeIndex enables pandas’ temporal superpowers: automatic date-based slicing,…
Read more →Pandas - Set/Reset Column as Index
• Setting a column as an index transforms it from regular data into row labels, enabling faster lookups and more intuitive data alignment—use set_index() for single or multi-level indexes without…
Pandas - Sort by Column Data Type (Custom Sort)
• Pandas doesn’t natively sort by column data types, but you can create custom sort keys using dtype information to reorder columns programmatically
Read more →Pandas - Select Columns by Data Type
• Use select_dtypes() to filter DataFrame columns by data type with include/exclude parameters, supporting both NumPy and pandas-specific types like ’number’, ‘object’, and ‘category’
Pandas - Select Columns by Index Position
The iloc[] indexer is the primary method for position-based column selection in Pandas. It uses zero-based integer indexing, making it ideal when you know the exact position of columns regardless…
Pandas - Select Multiple Columns
The most straightforward method for selecting multiple columns uses bracket notation with a list of column names. This approach is readable and works well when you know the exact column names.
Read more →Pandas - Select Rows Between Two Values
• Use boolean indexing with comparison operators to filter DataFrame rows between two values, combining conditions with the & operator for precise range selection
Pandas - Select Rows by Condition
Boolean indexing forms the foundation of conditional row selection in Pandas. You create a boolean mask by applying a condition to a column, then use that mask to filter the DataFrame.
Read more →Pandas - Select Rows by Date Range
Before filtering by date ranges, ensure your date column is in datetime format. Pandas won’t recognize string dates for time-based operations.
Read more →Pandas - Select Rows by Index (iloc)
The iloc indexer provides purely integer-location based indexing for selection by position. Unlike loc which uses labels, iloc treats the DataFrame as a zero-indexed array where the first row…
Pandas - Select Rows by Label (loc)
• The loc indexer selects rows and columns by label-based indexing, making it essential for working with labeled data in pandas DataFrames where you need explicit, readable selections based on…
Pandas - Rename Columns Using Dictionary
The rename() method accepts a dictionary where keys are current column names and values are new names. This approach only affects specified columns, leaving others unchanged.
Pandas - Reorder/Rearrange Columns
The most straightforward approach to reorder columns is passing a list of column names in your desired sequence. This creates a new DataFrame with columns arranged according to your specification.
Read more →Pandas - Replace NaN Values in Column
• Pandas offers multiple methods for replacing NaN values including fillna(), replace(), and interpolate(), each suited for different data scenarios and replacement strategies
Pandas - Replace Values in Column
The replace() method is the most versatile approach for substituting values in a DataFrame column. It works with scalar values, lists, and dictionaries.
Pandas - Resample Time Series Data
Resampling reorganizes time series data into new time intervals. Downsampling reduces frequency (hourly to daily), requiring aggregation. Upsampling increases frequency (daily to hourly), requiring…
Read more →Pandas - Reset Index of DataFrame
• The reset_index() method converts index labels into regular columns and creates a new default integer index, essential when you need to flatten hierarchical indexes or restore a clean numeric…
Pandas - Right Join DataFrames
A right join (right outer join) returns all records from the right DataFrame and matched records from the left DataFrame. When no match exists, Pandas fills left DataFrame columns with NaN values….
Read more →Pandas - Rolling Mean/Average
The rolling() method creates a window object that slides across your data, calculating the mean at each position. The most common use case involves a fixed-size window.
Pandas: Reshaping Data with Pivot and Melt
Data rarely arrives in the format you need. Your visualization library wants wide format, your machine learning model expects long format, and your database export looks nothing like either….
Read more →Pandas - Read JSON File (read_json)
• Pandas read_json() handles multiple JSON structures including records, split, index, columns, and values orientations, with automatic type inference and nested data flattening capabilities
Pandas - Read Multiple Sheets from Excel
• Use pd.read_excel() with the sheet_name parameter to read single, multiple, or all sheets from an Excel file into DataFrames or a dictionary of DataFrames
Pandas - Read Parquet File (read_parquet)
Parquet is a columnar storage format designed for analytical workloads. Unlike row-based formats like CSV, Parquet stores data by column, enabling efficient compression and selective column reading.
Read more →Pandas - Read Specific Columns from CSV
The usecols parameter in read_csv() is the most straightforward approach for reading specific columns. You can specify columns by name or index position.
Pandas - Read SQL Query into DataFrame (read_sql)
The read_sql() function executes SQL queries and returns results as a pandas DataFrame. It accepts both raw SQL strings and SQLAlchemy selectable objects, working with any database supported by…
Pandas - Rename Column by Index
When working with DataFrames from external sources, you’ll frequently encounter datasets with auto-generated column names, duplicate headers, or names that don’t follow Python naming conventions….
Read more →Pandas - Rename Column Names
The rename() method is the most versatile approach for changing column names in Pandas. It accepts a dictionary mapping old names to new names and returns a new DataFrame by default.
Pandas: Reading and Writing Files
Every data project starts and ends with file operations. You pull data from CSVs, databases, or APIs, transform it, then export results for downstream consumers. Pandas makes this deceptively…
Read more →Pandas - Read CSV File (read_csv)
The read_csv() function reads comma-separated value files into DataFrame objects. The simplest invocation requires only a file path:
Pandas - Read CSV Skip Rows/Header
• Use skiprows parameter with integers, lists, or callable functions to exclude specific rows when reading CSV files, reducing memory usage and processing time for large datasets
Pandas - Read CSV with Custom Delimiter
The read_csv() function in Pandas defaults to comma separation, but real-world data files frequently use alternative delimiters. The sep parameter (or its alias delimiter) accepts any string or…
Pandas - Read CSV with Different Encodings
• CSV files can have various encodings (UTF-8, Latin-1, Windows-1252) that cause UnicodeDecodeError if not handled correctly—detecting and specifying the right encoding is critical for data integrity
Read more →Pandas - Read Excel File (read_excel)
The read_excel() function is your primary tool for importing Excel data into pandas DataFrames. At minimum, you only need the file path:
Pandas - Read Fixed-Width File (read_fwf)
• read_fwf() handles fixed-width format files where columns are defined by character positions rather than delimiters, common in legacy systems and government data
Pandas - Read from S3 Bucket
• Pandas integrates seamlessly with S3 through the s3fs library, allowing you to read files directly using standard read_csv(), read_parquet(), and other I/O functions with S3 URLs
Pandas - Read HTML Table from URL
The read_html() function returns a list of all tables found in the HTML source. Each table becomes a separate DataFrame, indexed by its position in the document.
Pandas - Percentage Change (pct_change)
• The pct_change() method calculates percentage change between consecutive elements, essential for analyzing trends in time series data, financial metrics, and growth rates
Pandas - pipe() for Function Composition
• The pipe() method enables clean function composition in pandas by passing DataFrames through a chain of transformations, eliminating nested function calls and improving code readability
Pandas - Pivot (Reshape Long to Wide)
Long format stores each observation as a separate row with a variable column indicating what’s being measured. Wide format spreads observations across multiple columns. Consider sales data: long…
Read more →Pandas - Pivot Table with Examples
A pivot table reorganizes data from a DataFrame by specifying which columns become the new index (rows), which become columns, and what values to aggregate. The fundamental syntax requires three…
Read more →Pandas - Query Method for Filtering
The query() method accepts a string expression containing column names and comparison operators. Unlike traditional bracket notation, it eliminates the need for repetitive DataFrame references.
Pandas - Rank Values in Column
• Pandas provides multiple ranking methods (average, min, max, first, dense) that handle tied values differently, with the rank() method offering fine-grained control over ranking behavior
Pandas - Read Clipboard Data
• Pandas read_clipboard() provides instant data import from copied spreadsheet cells, eliminating the need for intermediate CSV files during exploratory analysis
Pandas: Performance Optimization Tips
Pandas is the workhorse of Python data analysis, but its default behaviors prioritize convenience over performance. This tradeoff works fine for small datasets, but becomes painful as data grows….
Read more →Pandas - Merge on Multiple Columns
Merging on multiple columns follows the same syntax as single-column merges, but passes a list to the on parameter. This creates a composite key where all specified columns must match for rows to…
Pandas - Merge Two DataFrames (merge)
The merge() function combines two DataFrames based on common columns or indexes. At its simplest, merge automatically detects common column names and uses them as join keys.
Pandas - Merge with Indicator Column
The indicator parameter in pd.merge() adds a special column to your merged DataFrame that tracks where each row originated. This column contains one of three categorical values: left_only,…
Pandas - Method Chaining Best Practices
Method chaining transforms verbose pandas code into elegant pipelines. Instead of creating multiple intermediate DataFrames that clutter your namespace and obscure the transformation logic, you…
Read more →Pandas - Move Column to First/Last Position
The most efficient way to move a column to the first position is combining insert() and pop(). The pop() method removes and returns the column, while insert() places it at the specified index.
Pandas - MultiIndex (Hierarchical Indexing) Tutorial
MultiIndex (hierarchical indexing) extends Pandas’ indexing capabilities by allowing multiple levels of labels on rows or columns. This structure is essential when working with multi-dimensional data…
Read more →Pandas - One-Hot Encoding with get_dummies
One-hot encoding transforms categorical data into a numerical format by creating binary columns for each unique category. If you have a ‘color’ column with values [‘red’, ‘blue’, ‘green’], pandas…
Read more →Pandas - Outer Join (Full Join) DataFrames
An outer join (also called a full outer join) combines two DataFrames by returning all rows from both DataFrames. When a match exists based on the join key, values from both DataFrames are combined….
Read more →Pandas: Merge vs Join vs Concat
Combining DataFrames is one of the most common operations in data analysis, yet Pandas offers three different methods that seem to do similar things: concat, merge, and join. This creates…
Pandas - Iterate Over Rows (iterrows, itertuples)
Pandas is built for vectorized operations. Before iterating over rows, exhaust these alternatives:
Read more →Pandas - Join on Index
Pandas provides the join() method specifically optimized for index-based operations. Unlike merge(), which defaults to column-based joins, join() leverages the DataFrame index structure for…
Pandas - Left Join DataFrames
A left join returns all records from the left DataFrame and matching records from the right DataFrame. When no match exists, pandas fills the right DataFrame’s columns with NaN values. This operation…
Read more →Pandas - Map Values in Column Using Dictionary
The map() method transforms values in a pandas Series using a dictionary as a lookup table. This is the most efficient approach for replacing categorical values.
Pandas - Melt (Reshape Wide to Long)
• The melt operation transforms wide-format data into long-format by unpivoting columns into rows, making it easier to analyze categorical data and perform group-based operations
Read more →Pandas - Memory Optimization Tips
• Pandas DataFrames can consume 10-100x more memory than necessary due to default data types—switching from int64 to int8 or using categorical types can reduce memory usage by 90% or more
Read more →Pandas: Memory Usage Reduction
Pandas defaults to memory-hungry data types. Load a CSV with a million rows, and Pandas will happily allocate 64-bit integers for columns that only contain values 0-10, and store repeated strings…
Read more →Pandas - GroupBy with Multiple Aggregations
The most straightforward approach to multiple aggregations uses a dictionary mapping column names to aggregation functions. This method works well when you need different metrics for different…
Read more →Pandas - GroupBy with Named Aggregation
• Named aggregation in Pandas GroupBy operations uses pd.NamedAgg() to create descriptive column names and maintain clear data transformation logic in production code
Pandas - Handle Missing Data (Complete Guide)
• Missing data in Pandas appears as NaN, None, or NaT (for datetime), and understanding detection methods prevents silent errors in analysis pipelines
Read more →Pandas - Inner Join DataFrames
An inner join combines two DataFrames by matching rows based on common column values, retaining only the rows where matches exist in both datasets. This is the default join type in Pandas and the…
Read more →Pandas - Insert Column at Specific Position
• Pandas provides multiple methods to insert columns at specific positions: insert() for in-place insertion, assign() with column reordering, and direct dictionary manipulation with…
Pandas - Insert Row at Specific Position
• Pandas doesn’t provide a native insert-at-index method for rows, requiring workarounds using concat(), iloc, or direct DataFrame construction
Pandas - Interpolate Missing Values
• Pandas offers six interpolation methods (linear, polynomial, spline, time-based, pad/backfill, and nearest) to handle missing values based on your data’s characteristics and requirements
Read more →Pandas: GroupBy with DataFrames
The GroupBy operation is one of the most powerful features in pandas, yet many developers underutilize it or misuse it entirely. At its core, GroupBy implements the split-apply-combine paradigm: you…
Read more →Pandas: Handling Missing Data
Every real-world dataset has holes. Missing data shows up as NaN (Not a Number), None, or NaT (Not a Time) in Pandas, and how you handle these gaps directly impacts the quality of your analysis.
Pandas - GroupBy and Max/Min
The fundamental pattern for finding maximum and minimum values within groups starts with the groupby() method followed by max() or min() aggregation functions.
Pandas - GroupBy and Mean/Average
The groupby() method splits data into groups based on one or more columns, then applies an aggregation function. Here’s the fundamental syntax for calculating means:
Pandas - GroupBy and Sum
The GroupBy sum operation is fundamental to data aggregation in Pandas. It splits your DataFrame into groups based on one or more columns, calculates the sum for each group, and returns the…
Read more →Pandas - GroupBy and Transform
The groupby() operation splits a DataFrame into groups based on one or more keys, applies a function to each group, and combines the results. This split-apply-combine pattern is fundamental to data…
Pandas - GroupBy Multiple Columns
• GroupBy with multiple columns creates hierarchical indexes that enable multi-dimensional data aggregation, essential for analyzing data across multiple categorical dimensions simultaneously.
Read more →Pandas - GroupBy Single Column
The groupby() method partitions a DataFrame based on unique values in a specified column. This operation doesn’t immediately compute results—it creates a GroupBy object that holds instructions for…
Pandas GroupBy - Complete Guide with Examples
• GroupBy operations split data into groups, apply functions, and combine results—understanding this split-apply-combine pattern is essential for efficient data analysis
Read more →Pandas GroupBy Patterns for Real-World Analysis
GroupBy is the workhorse of pandas analysis. These patterns handle the cases that basic tutorials skip.
Read more →Pandas - Get Number of Rows and Columns
• Use .shape attribute to get both dimensions simultaneously as a tuple (rows, columns), which is the most efficient method for DataFrames
Pandas - Get Row Count of DataFrame
• Use len(df) for the fastest row count performance—it directly accesses the underlying index length without iteration
Pandas - Get Shape of DataFrame (Rows and Columns)
• The shape attribute returns a tuple (rows, columns) representing DataFrame dimensions, accessible without parentheses since it’s a property, not a method
Pandas - Get Year/Month/Day from Datetime Column
• Pandas provides multiple methods to extract date components from datetime columns, including .dt accessor attributes, strftime() formatting, and direct attribute access—each with different…
Pandas - GroupBy and Aggregate (agg)
GroupBy operations follow a split-apply-combine pattern. Pandas splits your DataFrame into groups based on one or more keys, applies a function to each group, and combines the results.
Read more →Pandas - GroupBy and Apply Custom Function
The groupby() operation splits data into groups based on specified criteria, applies a function to each group independently, and combines results into a new data structure. When built-in…
Pandas - GroupBy and Count
• GroupBy operations in Pandas enable efficient data aggregation by splitting data into groups based on categorical variables, applying functions, and combining results into a structured output
Read more →Pandas - GroupBy and Filter Groups
GroupBy filtering differs fundamentally from standard DataFrame filtering. While df[df['column'] > value] filters individual rows, GroupBy filtering operates on entire groups. When you filter…
Pandas - GroupBy and First/Last
• GroupBy operations with first() and last() retrieve boundary records per group, essential for time-series analysis, deduplication, and state tracking across categorical data
Read more →Pandas - Get Column Names as List
• Pandas DataFrames provide multiple methods to extract column names, with df.columns.tolist() being the most explicit and list(df.columns) offering a Pythonic alternative
Pandas - Get Data Types of Columns (dtypes)
• Pandas provides multiple methods to inspect column data types: df.dtypes for all columns, df['column'].dtype for individual columns, and df.select_dtypes() to filter columns by type
Pandas - Get DataFrame Info and Memory Usage
The info() method is your first stop when examining a new DataFrame. It displays the DataFrame’s structure, including the number of entries, column names, non-null counts, data types, and memory…
Pandas - Get Day of Week from Datetime
• Pandas provides multiple methods to extract day of week from datetime objects, including dt.dayofweek, dt.weekday(), and dt.day_name(), each serving different formatting needs
Pandas - Get First N Rows (head) and Last N Rows (tail)
• The head() and tail() methods provide efficient ways to preview DataFrames without loading entire datasets into memory, with head(n) returning the first n rows and tail(n) returning the…
Pandas - Get Group Size after GroupBy
• Use .size() to count all rows per group including NaN values, while .count() excludes NaN values and returns counts per column
Pandas - Get Index of Rows Matching Condition
• Use boolean indexing with .index to retrieve index values of rows matching conditions, returning an Index object that preserves the original index type and structure
Pandas - Get N Largest/Smallest Values
• Pandas provides nlargest() and nsmallest() methods that outperform sorting-based approaches for finding top/bottom N values, especially on large datasets
Pandas - Drop Rows by Index
• Pandas offers multiple methods to drop rows by index including drop(), boolean indexing, and iloc[], each suited for different scenarios from simple deletions to complex conditional filtering
Pandas - Drop Rows with NaN Values (dropna)
• The dropna() method removes rows or columns containing NaN values with fine-grained control over thresholds, subsets, and axis selection
Pandas - Dummy Variables (get_dummies)
Dummy variables transform categorical data into a binary format where each unique category becomes a separate column with 1/0 values. This encoding is critical because most machine learning…
Read more →Pandas - eval() for Performance
Standard pandas operations create intermediate objects for each step in a calculation. When you write df['A'] + df['B'] + df['C'], pandas allocates memory for df['A'] + df['B'], then adds…
Pandas - Explode List Column to Rows
• The explode() method transforms list-like elements in a DataFrame column into separate rows, maintaining alignment with other columns through automatic index duplication
Pandas - Extract Hour/Minute/Second from Datetime
The .dt accessor in Pandas exposes datetime properties and methods for Series containing datetime64 data. Extracting hours, minutes, and seconds requires first ensuring your column is in datetime…
Pandas - Fill NaN Values (fillna) with Examples
Pandas represents missing data using NaN (Not a Number) from NumPy, None, or pd.NA. Before filling missing values, identify them using isna() or isnull():
Pandas - Filter DataFrame by Date Range
• Pandas offers multiple methods to filter DataFrames by date ranges, including boolean indexing, loc[], between(), and query(), each suited for different scenarios and performance requirements.
Pandas - Format Datetime Column (strftime)
• The strftime() method converts datetime objects to formatted strings using format codes like %Y-%m-%d, while dt.strftime() applies this to entire DataFrame columns efficiently
Pandas - Date Range Generation (date_range)
• pd.date_range() generates sequences of datetime objects with flexible frequency options, essential for time series analysis and data resampling operations
Pandas - Describe/Summary Statistics
• The describe() method provides comprehensive statistical summaries but can be customized with percentiles, inclusion rules, and data type filters to match specific analytical needs
Pandas - Display All Rows and Columns (set_option)
By default, Pandas truncates large DataFrames to prevent overwhelming your console with output. When you have a DataFrame with more than 60 rows or more than 20 columns, Pandas displays only a subset…
Read more →Pandas - Drop Column from DataFrame
• Pandas offers multiple methods to drop columns: drop(), pop(), direct deletion with del, and column selection—each suited for different use cases and performance requirements
Pandas - Drop Columns by Index
• Pandas provides multiple methods to drop columns by index position including drop() with column names, iloc for selection-based dropping, and direct DataFrame manipulation
Pandas - Drop Duplicate Rows
• The drop_duplicates() method removes duplicate rows based on all columns by default, but accepts parameters to target specific columns, choose which duplicate to keep, and control in-place…
Pandas - Drop Multiple Columns
• Pandas offers multiple methods to drop columns: drop() with column names, drop() with indices, and direct column selection—each suited for different scenarios and data manipulation patterns.
Pandas - Drop Rows by Condition
• Pandas offers multiple methods to drop rows based on conditions: boolean indexing with bracket notation, drop() with index labels, and query() for SQL-like syntax—each with distinct performance…
Pandas - Create DataFrame from List
A simple Python list becomes a single-column DataFrame by default. This is the most straightforward conversion when you have a one-dimensional dataset.
Read more →Pandas - Create DataFrame from NumPy Array
• Creating DataFrames from NumPy arrays requires understanding dimensionality—1D arrays become single columns, while 2D arrays map rows and columns directly to DataFrame structure
Read more →Pandas - Create DataFrame with Column Names
• DataFrames can be created from dictionaries, lists, or NumPy arrays with explicit column naming using the columns parameter or dictionary keys
Pandas - Create Empty DataFrame
• Creating empty DataFrames in Pandas requires understanding the difference between truly empty DataFrames, those with defined columns, and those with predefined structure including dtypes
Read more →Pandas - Cross Join DataFrames
A cross join (Cartesian product) combines every row from the first DataFrame with every row from the second DataFrame. If DataFrame A has m rows and DataFrame B has n rows, the result contains m × n…
Read more →Pandas - Cross Tabulation (crosstab)
• Cross tabulation transforms categorical data into frequency tables, revealing relationships between two or more variables that simple groupby operations miss
Read more →Pandas - Cumulative Sum (cumsum)
The cumsum() method computes the cumulative sum of elements along a specified axis. By default, it operates on each column independently, returning a DataFrame or Series with the same shape as the…
Pandas DataFrame Tutorial - Complete Guide with Examples
The most common way to create a DataFrame is from a dictionary where keys become column names:
Read more →Pandas: DataFrame Indexing and Selection
DataFrame indexing is where Pandas beginners stumble and intermediates get bitten by subtle bugs. The library offers multiple ways to select and modify data, each with distinct behaviors that can…
Read more →Pandas - Convert Column to String
• Use astype(str) for simple conversions, map(str) for element-wise control, and apply(str) when integrating with complex operations—each method handles null values differently
Pandas - Convert DataFrame to Dictionary
The to_dict() method accepts an orient parameter that determines the resulting dictionary structure. Each orientation serves different use cases, from API responses to data transformation…
Pandas - Convert DataFrame to List of Lists
• Converting DataFrames to lists of lists is a fundamental operation for data serialization, API responses, and interfacing with non-pandas libraries that expect nested list structures
Read more →Pandas - Convert DataFrame to NumPy Array
Pandas provides two primary methods for converting DataFrames to NumPy arrays: values and to_numpy(). While values has been the traditional approach, to_numpy() is now the recommended method.
Pandas - Convert Timestamp to Date
• Pandas provides multiple methods to convert timestamps to dates: dt.date, dt.normalize(), and dt.floor(), each serving different use cases from extracting date objects to maintaining…
Pandas - Count NaN/NULL Values in Column
• Pandas provides multiple methods to count NaN values including isna(), isnull(), and value_counts(dropna=False), each suited for different use cases and performance requirements.
Pandas - Create DataFrame from Clipboard
The read_clipboard() function works identically to read_csv() but sources data from your clipboard instead of a file. Copy any tabular data to your clipboard and execute:
Pandas - Create DataFrame from Dictionary
• Creating DataFrames from dictionaries is the most common pandas initialization pattern, with different dictionary structures producing different DataFrame orientations
Read more →Pandas - Change Column Data Type (astype)
• The astype() method is the primary way to convert DataFrame column types in pandas, supporting conversions between numeric, string, categorical, and datetime types with explicit control over the…
Pandas - Check if DataFrame is Empty
• Use df.empty for the fastest boolean check, len(df) == 0 for explicit row counting, or df.shape[0] == 0 when you need dimensional information simultaneously.
Pandas - Compare Two DataFrames for Differences
The simplest comparison uses DataFrame.equals() to determine if two DataFrames are identical:
Pandas - Concatenate Along Rows vs Columns
• pd.concat() uses the axis parameter to control concatenation direction: axis=0 stacks DataFrames vertically (along rows), while axis=1 joins them horizontally (along columns)
Pandas - Concatenate DataFrames (concat)
The default behavior of pd.concat() stacks DataFrames vertically, appending rows from multiple DataFrames into a single structure. This is the most common use case when combining datasets with…
Pandas - Convert Column to Categorical
Categorical data represents a fixed set of possible values, typically strings or integers representing discrete groups. In Pandas, the categorical dtype stores data internally as integer codes mapped…
Read more →Pandas - Convert Column to Datetime
The pd.to_datetime() function converts string or numeric columns to datetime objects. For standard ISO 8601 formats, Pandas automatically detects the pattern:
Pandas - Convert Column to Float
The astype() method provides the most straightforward approach for converting a pandas column to float when your data is already numeric or cleanly formatted.
Pandas - Convert Column to Integer
• Converting columns to integers in Pandas requires handling null values first, as standard int types cannot represent missing data—use Int64 (nullable integer) or fill/drop nulls before conversion
Read more →Pandas - Add/Subtract Days from Date
The most straightforward approach to adding or subtracting days uses pd.Timedelta. This method works with both individual datetime objects and entire Series.
Pandas - Append DataFrames
Appending DataFrames is a fundamental operation in data manipulation workflows. The primary method is pd.concat(), which concatenates pandas objects along a particular axis with optional set logic…
Pandas - Apply Function to Column
• The apply() method transforms DataFrame columns using custom functions, lambda expressions, or built-in functions, offering more flexibility than vectorized operations for complex transformations
Pandas - Apply Lambda Function to Column
• Lambda functions with apply() provide a concise way to transform DataFrame columns without writing separate function definitions, ideal for simple operations like string manipulation,…
Pandas - assign() to Add Computed Columns
• The assign() method enables functional-style column creation by returning a new DataFrame rather than modifying in place, making it ideal for method chaining and immutable data pipelines.
Pandas - Bin Continuous Data (cut/qcut)
Binning transforms continuous numerical data into discrete categories or intervals. This technique is essential for data analysis, visualization, and machine learning feature engineering. Pandas…
Read more →Pandas - Calculate Difference Between Dates
Pandas handles date differences through direct subtraction of datetime64 objects, which returns a Timedelta object representing the duration between two dates.
Pandas - Add Column Based on Another Column
The simplest way to add a column based on another is through direct arithmetic operations. Pandas broadcasts these operations across the entire column efficiently.
Read more →Pandas - Add Column with Default/Constant Value
• Adding constant columns in Pandas can be done through direct assignment, assign(), or insert() methods, each with specific use cases for performance and readability
Pandas - Add Multiple Columns
The most straightforward approach to adding multiple columns is direct assignment. You can assign multiple columns at once using a list of column names and corresponding values.
Read more →Pandas - Add New Column to DataFrame
The simplest method to add a column is direct assignment using bracket notation. This approach works for scalar values, lists, arrays, or Series objects.
Read more →Pandas - Add Row to DataFrame (append/concat)
Pandas deprecated the append() method because it was inefficient and created confusion about in-place operations. The method always returned a new DataFrame, leading developers to mistakenly chain…
How to Write to CSV in Pandas
Every data pipeline eventually needs to export data somewhere. CSV remains the universal interchange format—it’s human-readable, works with Excel, imports into databases, and every programming…
Read more →How to Write to Excel in Pandas
Pandas makes exporting data to Excel straightforward, but the simplicity of df.to_excel() hides a wealth of options that can transform your output from a raw data dump into a polished,…
How to Write to SQL in Pandas
Pandas excels at data manipulation, but eventually you need to persist your work somewhere more durable than a CSV file. SQL databases remain the backbone of most production data systems, and pandas…
Read more →How to Use Window Functions in Pandas
Window functions compute values across a ‘window’ of rows related to the current row. Unlike aggregation with groupby(), which collapses multiple rows into one, window functions preserve your…
How to Use Value Counts in Pandas
When you’re exploring a new dataset, one of the first questions you’ll ask is ‘what values exist in this column and how often do they appear?’ The value_counts() method answers this question…
How to Use Transform in Pandas
Pandas gives you three main methods for applying functions to data: apply(), agg(), and transform(). Understanding when to use each one will save you hours of debugging and rewriting code.
How to Use str.replace in Pandas
Real-world data is messy. You’ll encounter inconsistent formatting, unwanted characters, legacy encoding issues, and text that needs standardization before analysis. Pandas’ str.replace() method is…
How to Use str.split in Pandas
String splitting is one of the most common data cleaning operations you’ll perform in Pandas. Whether you’re parsing CSV-like fields, extracting usernames from email addresses, or breaking apart full…
Read more →How to Use String Operations in Pandas
Working with text data in Pandas requires a different approach than numerical operations. The .str accessor unlocks a suite of vectorized string methods that operate on entire Series at once,…
How to Use str.contains in Pandas
String matching is one of the most common operations when working with text data in pandas. Whether you’re filtering customer names, searching product descriptions, or parsing log files, you need a…
Read more →How to Use str.extract in Pandas
Pandas’ str.extract method solves a specific problem: you have a column of strings containing structured information buried in text, and you need to pull that information into usable columns. Think…
How to Use Rolling Window in Pandas
Rolling windows—also called sliding windows or moving windows—are a fundamental technique for analyzing sequential data. The concept is straightforward: take a fixed-size window, calculate a…
Read more →How to Use Pipe in Pandas
If you’ve written Pandas code for any length of time, you’ve probably encountered the readability nightmare of nested function calls or sprawling intermediate variables. The pipe() method solves…
How to Use Query in Pandas
Pandas gives you two main ways to filter DataFrames: boolean indexing and the query() method. Most tutorials focus on boolean indexing because it’s the traditional approach, but query() often…
How to Use pd.cut in Pandas
Continuous numerical data is messy. When you’re analyzing customer ages, transaction amounts, or test scores, the raw numbers often obscure patterns that become obvious once you group them into…
Read more →How to Use pd.qcut in Pandas
Binning continuous data into discrete categories is a fundamental data preparation task. Pandas offers two primary functions for this: pd.cut and pd.qcut. Understanding when to use each will save…
How to Use Melt in Pandas
Data rarely arrives in the format you need. You’ll encounter ‘wide’ datasets where each variable gets its own column, and ’long’ datasets where observations stack vertically with categorical…
Read more →How to Use loc in Pandas
Pandas provides two primary indexers for accessing data: loc and iloc. Understanding the difference between them is fundamental to writing clean, bug-free data manipulation code.
How to Use Map in Pandas
Pandas gives you several ways to transform data, and choosing the wrong one leads to slower code and confused teammates. The map() function is your go-to tool for element-wise transformations on a…
How to Use json_normalize in Pandas
Nested JSON is everywhere. APIs return it, NoSQL databases store it, and configuration files depend on it. But pandas DataFrames expect flat, tabular data. The gap between these two worlds causes…
Read more →How to Use iloc in Pandas
Pandas provides two primary indexers for accessing data: loc and iloc. While they look similar, they serve fundamentally different purposes. iloc stands for ‘integer location’ and uses…
How to Use GroupBy in Pandas
Pandas GroupBy is one of those features that separates beginners from practitioners. Once you internalize it, you’ll find yourself reaching for it constantly—summarizing sales by region, calculating…
Read more →How to Use Get Dummies in Pandas
Machine learning algorithms work with numbers, not strings. When your dataset contains categorical variables like ‘red’, ‘blue’, or ‘green’, you need to convert them into a numerical format. One-hot…
Read more →How to Use Eval in Pandas
Pandas provides two eval functions that let you evaluate string expressions against your data: the top-level pd.eval() and the DataFrame method df.eval(). Both parse and execute expressions…
How to Use Expanding Window in Pandas
Expanding windows are one of Pandas’ most underutilized features. While most developers reach for rolling windows when they need windowed calculations, expanding windows solve a fundamentally…
Read more →How to Use Describe in Pandas
Exploratory data analysis starts with one question: what does my data actually look like? Before building models, creating visualizations, or writing complex transformations, you need to understand…
Read more →How to Use Apply in Pandas
The apply() function in pandas lets you run custom functions across your data. It’s the escape hatch you reach for when pandas’ built-in methods don’t cover your use case. Need to parse a custom…
How to Use Applymap in Pandas
When you need to transform every single element in a Pandas DataFrame, applymap() is your tool. It takes a function and applies it to each cell individually, returning a new DataFrame with the…
How to Use Assign in Pandas
The assign() method is one of pandas’ most underappreciated features. It creates new columns on a DataFrame and returns a copy with those columns added. This might sound trivial—after all, you can…
How to Unpivot a DataFrame with Melt in Pandas
Data rarely arrives in the format you need. Wide-format data—where each column represents a different observation—is common in spreadsheets and exports, but most analysis tools expect long-format…
Read more →How to Use Agg with Multiple Functions in Pandas
Pandas provides convenient single-function aggregation methods like sum(), mean(), and max(). They work fine when you need one statistic. But real-world data analysis rarely stops at a single…
How to Stack and Unstack in Pandas
Pandas provides two complementary methods for reshaping data: stack() and unstack(). These operations pivot data between ’long’ and ‘wide’ formats by moving index levels between the row and…
How to Sort a DataFrame in Pandas
Sorting is one of the most frequent operations you’ll perform during data analysis. Whether you’re finding top performers, organizing time-series data chronologically, or simply making a DataFrame…
Read more →How to Sort by Index in Pandas
Pandas DataFrames maintain an index that serves as the row identifier, but this index doesn’t always stay in the order you expect. After merging datasets, filtering rows, or creating custom indices,…
Read more →How to Sort by Multiple Columns in Pandas
Sorting data by a single column is straightforward, but real-world analysis rarely stays that simple. You need to sort sales data by region first, then by revenue within each region. You need…
Read more →How to Select Rows by Index in Pandas
Row selection is fundamental to every Pandas workflow. Whether you’re extracting a subset for analysis, debugging data issues, or preparing training sets, you need precise control over which rows…
Read more →How to Set Index in Pandas
Every pandas DataFrame has an index, whether you set one explicitly or accept the default integer sequence. The index isn’t just a row label—it’s the backbone of pandas’ data alignment system. When…
Read more →How to Shift Values in Pandas
Shifting values is one of the most fundamental operations in time series analysis and data manipulation. The pandas shift() method moves data up or down along an axis, creating offset versions of…
How to Select Columns in Pandas
Column selection is the bread and butter of pandas work. Before you can clean, transform, or analyze data, you need to extract the specific columns you care about. Whether you’re dropping irrelevant…
Read more →How to Resample Time Series Data in Pandas
Resampling is the process of changing the frequency of your time series data. If you have stock prices recorded every minute and need daily summaries, that’s downsampling. If you have monthly revenue…
Read more →How to Reset Index in Pandas
Understanding how to manipulate DataFrame indexes is fundamental to working effectively with pandas. The index isn’t just a row label—it’s a powerful tool for data alignment, fast lookups, and…
Read more →How to Right Join in Pandas
A right join returns all rows from the right DataFrame and the matched rows from the left DataFrame. When there’s no match in the left DataFrame, the result contains NaN values for those columns.
Read more →How to Sample Random Rows in Pandas
Random sampling is fundamental to practical data work. You need it for exploratory data analysis when you can’t eyeball a million rows. You need it for creating train/test splits in machine learning…
Read more →How to Read Parquet Files in Pandas
Parquet is a columnar storage format that has become the de facto standard for analytical workloads. Unlike row-based formats like CSV where data is stored record by record, Parquet stores data…
Read more →How to Rename Columns in Pandas
Every data scientist has opened a CSV file only to find column names like Unnamed: 0, cust_nm_1, or Total Revenue (USD) - Q4 2023. Messy column names create friction throughout your analysis…
How to Rank Values in Pandas
Ranking assigns ordinal positions to values in a dataset. Instead of asking ‘what’s the value?’, you’re asking ‘where does this value stand relative to others?’ This distinction matters in countless…
Read more →How to Read CSV Files in Pandas
CSV files remain the lingua franca of data exchange. Despite the rise of Parquet, JSON, and database connections, you’ll encounter CSVs constantly—from client exports to API downloads to legacy…
Read more →How to Read Excel Files in Pandas
Excel files remain stubbornly ubiquitous in data workflows. Whether you’re receiving sales reports from finance, customer data from marketing, or research datasets from academic partners, you’ll…
Read more →How to Read JSON Files in Pandas
JSON has become the lingua franca of web APIs and configuration files. It’s human-readable, flexible, and ubiquitous. But flexibility comes at a cost—JSON’s nested, hierarchical structure doesn’t map…
Read more →How to Pivot a DataFrame in Pandas
Pivoting transforms data from a ’long’ format (many rows, few columns) to a ‘wide’ format (fewer rows, more columns). If you’ve ever received transactional data where each row represents a single…
Read more →How to One-Hot Encode in Pandas
One-hot encoding transforms categorical variables into a numerical format that machine learning algorithms can process. Most algorithms expect numerical input, and simply converting categories to…
Read more →How to Outer Join in Pandas
An outer join combines two DataFrames while preserving all records from both sides, regardless of whether a matching key exists. When a row from one DataFrame has no corresponding match in the other,…
Read more →How to Left Join in Pandas
A left join returns all rows from the left DataFrame and the matched rows from the right DataFrame. When there’s no match, the result contains NaN values for columns from the right DataFrame.
How to Merge DataFrames in Pandas
Every real-world data project involves combining datasets. You have customer information in one table, their transactions in another, and product details in a third. Getting useful insights means…
Read more →How to Merge on Index in Pandas
Most pandas tutorials focus on merging DataFrames using columns, but index-based merging is often the cleaner, faster approach—especially when your data naturally has meaningful identifiers like…
Read more →How to Merge on Multiple Columns in Pandas
Single-column merges work fine until they don’t. Consider a sales database where you need to join transaction records with inventory data. Using just product_id fails when you have multiple…
How to Interpolate Missing Values in Pandas
Missing values appear in datasets for countless reasons: sensor malfunctions, network timeouts, manual data entry errors, or simply gaps in data collection schedules. When you encounter NaN values in…
Read more →How to Iterate Over Rows in Pandas
Row iteration is one of those topics where knowing how to do something is less important than knowing when to do it. Pandas is built on NumPy, which processes entire arrays in optimized C code….
Read more →How to Join DataFrames in Pandas
Combining data from multiple sources is one of the most common operations in data analysis. Whether you’re merging customer records with transaction data, combining time series from different…
Read more →How to Label Encode in Pandas
Machine learning algorithms work with numbers, not text. When your dataset contains categorical columns like ‘color,’ ‘size,’ or ‘region,’ you need to convert these string values into numerical…
Read more →How to Inner Join in Pandas
An inner join combines two DataFrames by keeping only the rows where the join key exists in both tables. If a key appears in one DataFrame but not the other, that row gets dropped. This makes inner…
Read more →How to Handle MultiIndex in Pandas
Hierarchical indexing (MultiIndex) lets you work with higher-dimensional data in a two-dimensional DataFrame. Instead of creating separate DataFrames or adding redundant columns, you encode multiple…
Read more →How to GroupBy Multiple Columns in Pandas
Single-column groupby operations are fine for tutorials, but real data analysis rarely works that way. You need to group sales by region and product category. You need to analyze user behavior by…
Read more →How to Handle Categorical Data in Pandas
Categorical data appears everywhere in real-world datasets: customer segments, product categories, geographic regions, survey responses. Yet most pandas users treat these columns as plain strings,…
Read more →How to GroupBy and Aggregate in Pandas
Pandas GroupBy is one of the most powerful features for data analysis, yet many developers underutilize it or struggle with its syntax. At its core, GroupBy implements the split-apply-combine…
Read more →How to GroupBy and Apply Custom Function in Pandas
Pandas GroupBy is one of the most powerful features for data analysis, but the real magic happens when you move beyond built-in aggregations like sum() and mean(). Custom functions let you…
How to GroupBy and Count in Pandas
Counting things is the foundation of data analysis. Before you build models or create visualizations, you need to understand what’s in your data: How many orders per customer? How many defects per…
Read more →How to GroupBy and Sum in Pandas
Grouping data by categories and calculating sums is one of the most common operations in data analysis. Whether you’re calculating total sales by region, summing expenses by department, or…
Read more →How to Forward Fill in Pandas
Forward fill is exactly what it sounds like: it takes the last known valid value and carries it forward to fill subsequent missing values. If you have a sensor reading at 10:00 AM and missing data at…
Read more →How to Filter by String Contains in Pandas
String filtering is one of the most common operations you’ll perform in data analysis. Whether you’re searching through server logs for error messages, filtering customer names by keyword, or…
Read more →How to Filter NaN Values in Pandas
NaN values are the silent saboteurs of data analysis. They creep into your datasets from incomplete API responses, failed data entry, sensor malfunctions, or mismatched joins. Left unchecked, they’ll…
Read more →How to Filter Rows in Pandas
Row filtering is something you’ll do in virtually every pandas workflow. Whether you’re cleaning messy data, preparing subsets for analysis, or extracting records that meet specific criteria,…
Read more →How to Fill NaN Values in Pandas
Missing data is inevitable in real-world datasets. Whether it’s a sensor that failed to record a reading, a user who skipped a form field, or data that simply doesn’t exist for certain combinations,…
Read more →How to Fill NaN with Mean in Pandas
Missing data is inevitable. Whether you’re working with survey responses, sensor readings, or scraped web data, you’ll encounter NaN values that need handling before analysis or modeling. Mean…
Read more →How to Fill NaN with Median in Pandas
Missing data is inevitable. Whether you’re working with sensor readings, survey responses, or scraped web data, you’ll encounter NaN values that need handling before analysis or modeling. The…
Read more →How to Fill NaN with Zero in Pandas
NaN (Not a Number) values are the bane of data analysis. They creep into your DataFrames from missing CSV fields, failed API calls, mismatched joins, and countless other sources. Before you can…
Read more →How to Filter by Column Value in Pandas
Filtering DataFrames by column values is something you’ll do constantly in pandas. Whether you’re cleaning data, preparing features for machine learning, or generating reports, selecting rows that…
Read more →How to Filter by Date in Pandas
Date filtering is one of the most common operations in data analysis. Whether you’re analyzing sales trends, processing server logs, or building financial reports, you’ll inevitably need to slice…
Read more →How to Filter by Multiple Conditions in Pandas
Filtering DataFrames by multiple conditions is one of the most common operations in data analysis. Whether you’re isolating customers who meet specific criteria, cleaning datasets by removing…
Read more →How to Drop Duplicate Rows in Pandas
Duplicate rows are inevitable in real-world datasets. They creep in through database merges, manual data entry errors, repeated API calls, or CSV imports that accidentally run twice. Left unchecked,…
Read more →How to Drop Duplicates Based on Specific Columns in Pandas
Duplicate data silently corrupts analysis. You calculate average order values, but some customers appear three times. You count unique users, but the same email shows up with different…
Read more →How to Explode a Column in Pandas
When working with real-world data, you’ll frequently encounter columns containing list-like values. Maybe you’re parsing JSON from an API, dealing with multi-select form fields, or processing…
Read more →How to Delete a Column in Pandas
Deleting columns from a DataFrame is one of the most frequent operations in data cleaning. Whether you’re removing irrelevant features before model training, dropping columns with too many null…
Read more →How to Cross Join in Pandas
A cross join, also called a Cartesian product, combines every row from one table with every row from another table. If DataFrame A has 3 rows and DataFrame B has 4 rows, the result contains 12…
Read more →How to Create a Pivot Table in Pandas
Pivot tables are one of the most practical tools in data analysis. They take flat, transactional data and reshape it into a summarized format where you can instantly spot patterns, compare…
Read more →How to Create a Crosstab in Pandas
A crosstab—short for cross-tabulation—is a table that displays the frequency distribution of variables. Think of it as a pivot table specifically designed for categorical data. When you need to…
Read more →How to Create a DataFrame from a Dictionary in Pandas
When you’re working with Pandas, the DataFrame is everything. It’s the central data structure you’ll manipulate, analyze, and transform. And more often than not, your data starts life as a Python…
Read more →How to Create a DataFrame from a List in Pandas
DataFrames are the workhorse of Pandas. They’re essentially in-memory tables with labeled rows and columns, and nearly every data analysis task starts with getting your data into one. While Pandas…
Read more →How to Convert Column to Datetime in Pandas
Every data analysis project involving dates starts the same way: you load a CSV, check your dtypes, and discover your date column is stored as object (strings). This is the default behavior, and…
How to Convert DataFrame to NumPy Array in Pandas
Converting a pandas DataFrame to a NumPy array is one of those operations you’ll reach for constantly. Machine learning libraries like scikit-learn expect NumPy arrays. Mathematical operations run…
Read more →How to Concatenate DataFrames in Pandas
Concatenation in Pandas means combining two or more DataFrames into a single DataFrame. Unlike merging, which combines data based on shared keys (similar to SQL joins), concatenation simply glues…
Read more →How to Check Data Types in Pandas
Data types in Pandas aren’t just metadata—they determine what operations you can perform, how much memory your DataFrame consumes, and whether your calculations produce correct results. A column that…
Read more →How to Check DataFrame Info in Pandas
Every data analysis project starts the same way: you load a dataset and immediately need to understand what you’re working with. How many rows? What columns exist? Are there missing values? What data…
Read more →How to Change Data Types with Astype in Pandas
Data type conversion is one of those unglamorous but essential pandas operations you’ll perform constantly. When you load a CSV file, pandas guesses at column types—and it often guesses wrong….
Read more →How to Calculate Percent Change in Pandas
Percent change is one of the most fundamental calculations in data analysis. Whether you’re tracking stock returns, measuring revenue growth, analyzing user engagement metrics, or monitoring…
Read more →How to Calculate Cumulative Sum in Pandas
Cumulative sum—also called a running total—is one of those operations you’ll reach for constantly once you know it exists. It answers questions like ‘What’s my account balance after each…
Read more →How to Backward Fill in Pandas
Backward fill is a data imputation technique that fills missing values with the next valid observation in a sequence. Unlike forward fill, which carries previous values forward, backward fill looks…
Read more →How to Bin Data in Pandas
Binning—also called discretization or bucketing—converts continuous numerical data into discrete categories. You take a range of values and group them into bins, turning something like ‘age: 27’ into…
Read more →How to Append Rows to a DataFrame in Pandas
Appending rows to a DataFrame is one of the most common operations in data manipulation. Whether you’re processing streaming data, aggregating results from an API, or building datasets incrementally,…
Read more →How to Apply a Function to a Column in Pandas
Applying functions to columns is one of the most common operations in pandas. Whether you’re cleaning messy text data, engineering features for a machine learning model, or transforming values based…
Read more →How to Apply a Function to Multiple Columns in Pandas
Applying functions to multiple columns is one of the most common operations in pandas. Whether you’re calculating derived metrics, cleaning inconsistent data, or engineering features for machine…
Read more →How to Add a New Column in Pandas
Adding columns to a Pandas DataFrame is one of the most common operations you’ll perform in data analysis. Whether you’re calculating derived metrics, categorizing data, or preparing features for…
Read more →