DataFrame Operations
On this page
Purpose
DataFrame Operations changes rows or columns in one DataFrame. Each node runs one selected operation and returns a DataFrame.
When to use it
- Filter or sort tabular results.
- Add, remove, rename, or select columns.
- Preview the first or last rows.
- Replace values or remove duplicate rows before downstream processing.
How to use it
- Connect a DataFrame-producing component to DataFrame.
- Select an Operation.
- Set the fields shown for that operation.
- Connect the resulting DataFrame to the next component.
Configuration
| Operation | Visible fields | What it does |
|---|---|---|
| Add Column | New Column Name, New Column Value | Adds a constant to every row. An existing name is overwritten. |
| Drop Column | Column Name | Removes one named column. |
| Filter | Column Name, Filter Value, Filter Operator | Keeps matching rows. equals is the default. |
| Head | Number of Rows | Returns the first rows. The default is 5. |
| Rename Column | Column Name, New Column Name | Renames one column. A missing source name leaves the table unchanged. |
| Replace Value | Column Name, Value to Replace, Replacement Value | Replaces exact values in one column. |
| Select Columns | Columns to Select | Keeps entered columns in entered order. |
| Sort | Column Name, Sort Ascending | Sorts one column. Sort Ascending defaults to on. |
| Tail | Number of Rows | Returns the last rows. The default is 5. |
| Drop Duplicates | Column Name | Keeps the first row for each value in one column. |
Each node runs one operation. Use another DataFrame Operations node for the next transformation.
Expected result
The component always returns a DataFrame. Head and Tail return all available rows when the input has fewer rows than requested. With no selected operation, it returns an unchanged copy. Column names are case-sensitive. Changing Operation hides old values but does not clear them.
Reference details
The Filter contains operator follows pandas matching behavior, including its regex handling. Ordered filters try numeric comparison, then fall back to string comparison when conversion fails. Rename Column can leave the table unchanged when the named column is absent. Select Columns and the other column operations raise an error for a missing or case-mismatched column.
Related components
- News Search and RSS Reader return DataFrames that can be filtered or sorted.
- Google Sheet returns direct-action results as a DataFrame.
- Structured Output can return one extracted row per record.