Starburst Connector for Python

Starburst Connector empowers you to connect to your Starburst Trino instance, the fastest open source, massively parallel processing SQL query engine designed for analytics on your data lake, as well as other data sources.

In this article you will learn how to quickly and efficiently integrate Starburst data in Python. We will use high-performance Starburst Connector to easily connect to Starburst and then access the data inside Python.

Let's follow the steps below to see how we can accomplish that!

Download Documentation

Prerequisites

Before we begin, make sure you meet the following prerequisite:

If you already have a JRE installed, you can try using it too. However, if you experience any issues, we recommend using one of the distributions mentioned above (you can install an additional JRE next to the existing one; just don't forget to configure the default Java in the Windows Environment Variables).

Download Starburst JDBC driver

To connect to Starburst in Python, you will have to download JDBC driver for it, which we will use in later steps. Let's perform these little steps right away:

  1. Visit Starburst website.
  2. Follow the instructions there, download the JDBC driver, and save it locally, e.g. to D:\Drivers\JDBC\trino-jdbc.jar.
    It is recommended to use JDBC driver compiled for Java 8, if possible.
  3. Done! That was easy, wasn't it? Let's proceed to the next step.

Create ODBC Data Source (DSN) based on ZappySys JDBC Bridge Driver

Step-by-step instructions

To get data from Starburst using Python we first need to create a DSN (Data Source) which will access data from Starburst. We will later be able to read data using Python. Perform these steps:

  1. Download and install ODBC PowerPack.

  2. Open ODBC Data Sources (x64):

    Open ODBC Data Source
  3. Create a User data source (User DSN) based on ZappySys JDBC Bridge Driver

    ZappySys JDBC Bridge Driver
    Create new User DSN for ZappySys JDBC Bridge Driver
    • Create and use User DSN if the client application is run under a User Account. This is an ideal option in design-time, when developing a solution, e.g. in Visual Studio 2019. Use it for both type of applications - 64-bit and 32-bit.
    • Create and use System DSN if the client application is launched under a System Account, e.g. as a Windows Service. Usually, this is an ideal option to use in a production environment. Use ODBC Data Source Administrator (32-bit), instead of 64-bit version, if Windows Service is a 32-bit application.
  4. Now, we need to configure the JDBC connection in the new ODBC data source. Simply enter the Connection string, credentials, configure other settings, and then click Test Connection button to test the connection:

    StarburstDSN
    jdbc:trino://trino-instance-host-name:8080
    D:\Drivers\JDBC\trino-jdbc.jar
    admin
    ****************
    []
    JDBC-ODBC Bridge driver data source settings

    Use these values when setting parameters:

    • Connection string: jdbc:trino://trino-instance-host-name:8080
    • JDBC driver file(s): D:\Drivers\JDBC\trino-jdbc.jar
    • User name: admin
    • User password: ****************
    • Connection parameters: []

  5. You should see a message saying that connection test is successful:

    ODBC connection test is successful

    Otherwise, if you are getting an error, check out our Community for troubleshooting tips.

  6. We are at the point where we can preview a SQL query. For more SQL query examples visit JDBC Bridge documentation:

    StarburstDSN
    SELECT * FROM tpch.sf1.orders
    JDBC ODBC Bridge data source preview
    SELECT * FROM tpch.sf1.orders
    You can also click on the <Select Table> dropdown and select a table from the list.

    The ZappySys JDBC Bridge Driver acts as a transparent intermediary, passing SQL queries directly to the Trino JDBC driver, which then handles the query execution. This means the Bridge Driver simply relays the SQL query without altering it.

    Some JDBC drivers don't support INSERT/UPDATE/DELETE statements, so you may get an error saying "action is not supported" or a similar one. Please, be aware, this is not the limitation of ZappySys JDBC Bridge Driver, but is a limitation of the specific JDBC driver you are using.

  7. Click OK to finish creating the data source.

Video Tutorial

Read data in Python

Using ODBC DSN

  1. Python code to get the data:

    StarburstDSN')
    Python code to get the data from ZappySys DSN

  2. When you run the code it will make the API call and read the data:
    Python - Extracted data from ZappySys DSN

  3. Here is Python program's code in text format:

    
        import pyodbc
        conn = pyodbc.connect('DSN=StarburstDSN')
    
        cursor = conn.cursor()
    
        #execute query to fetch data from API service
        cursor.execute("SELECT id,title FROM products")
    
        row = cursor.fetchone()
        while row:
            print(row)
            row = cursor.fetchone()
    
        ##For loop example
        #for row in cursor:
        #    print(row)
    

Using a full ODBC connection string

If you want to avoid being dependent on a DSN and creating multiple DSNs for each platform (x86, x64), then you can use a fully qualified connection string. Simply go to your DSN and copy the Connection String:

  1. Open ODBC data source configuration and click Copy settings:
    ZappySys JDBC Bridge Driver - Starburst
    Starburst Connector empowers you to connect to your Starburst Trino instance, the fastest open source, massively parallel processing SQL query engine designed for analytics on your data lake, as well as other data sources.
    StarburstDSN
    Copy connection string for ODBC application
  2. The window opens, telling us the connection string was successfully copied to the clipboard: Successful connection string copying for ODBC application
  3. Then in your Python code use Connection String when initializing OdbcConnection object, for example:

    conn = pyodbc.connect('DRIVER={ZappySys JDBC Bridge Driver};ServiceUrl=https://yourservices.provider.com/api/xxxx....;AuthName=Http;')

How to install `pyodbc` in the Python?

You would need to install pyodbc in Python if you intend to establish connections to databases that support ODBC (Open Database Connectivity). This module facilitates communication between Python applications and various database management systems, enabling you to perform operations such as querying, retrieving data, and managing databases. Here's how you can install pyodbc in Python:

Installation Steps:

  1. Ensure you have Python installed on your system. If not, download it from the official Python website and follow the installation instructions.

  2. Open your terminal or command prompt.

  3. Use the following command to install pyodbc using pip, the Python package installer:

    python -m pip install "pyodbc"

    Make sure you have a stable internet connection and the necessary permissions to install Python packages.


    Python - pip install pyodbc

Reasons to Install:

  • If pyodbc is not installed, your Python script will generate the following error:
    "ModuleNotFoundError: No module named 'pyodbc'"
    .
  • Database Connectivity: pyodbc allows Python to connect to various databases that support ODBC, such as Microsoft SQL Server, PostgreSQL, MySQL, and more.

  • Data Operations: It facilitates the execution of SQL queries, retrieval of data, and other database operations from within Python scripts.

  • Cross-Platform Support: pyodbc is designed to work across different operating systems, including Windows, macOS, and various Linux distributions.

  • Simplicity and Efficiency: The module provides an intuitive interface for managing database transactions and connections, simplifying the process of working with databases in Python.

By installing pyodbc, you can seamlessly integrate your Python applications with a wide range of ODBC-supported databases, enabling efficient and effective data management and analysis.

Conclusion

In this article we showed you how to connect to Starburst in Python and integrate data without any coding, saving you time and effort. It's worth noting that ZappySys JDBC Bridge Driver allows you to connect not only to Starburst, but to any Java application that supports JDBC (just use a different JDBC driver and configure it appropriately).

We encourage you to download Starburst Connector for Python and see how easy it is to use it for yourself or your team.

If you have any questions, feel free to contact ZappySys support team. You can also open a live chat immediately by clicking on the chat icon below.

Download Starburst Connector for Python Documentation

More integrations

Other connectors for Python

All
Big Data & NoSQL
Database
CRM & ERP
Marketing
Collaboration
Cloud Storage
Reporting
Commerce
API & Files

Other application integration scenarios for Starburst

All
Data Integration
Database
BI & Reporting
Productivity
Programming Languages
Automation & Scripting
ODBC applications

  • How to connect Starburst in Python?

  • How to get Starburst data in Python?

  • How to read Starburst data in Python?

  • How to load Starburst data in Python?

  • How to import Starburst data in Python?

  • How to pull Starburst data in Python?

  • How to push data to Starburst in Python?

  • How to write data to Starburst in Python?

  • How to POST data to Starburst in Python?

  • Call Starburst API in Python

  • Consume Starburst API in Python

  • Starburst Python Automate

  • Starburst Python Integration

  • Integration Starburst in Python

  • Consume real-time Starburst data in Python

  • Consume real-time Starburst API data in Python

  • Starburst ODBC Driver | ODBC Driver for Starburst | ODBC Starburst Driver | SSIS Starburst Source | SSIS Starburst Destination

  • Connect Starburst in Python

  • Load Starburst in Python

  • Load Starburst data in Python

  • Read Starburst data in Python

  • Starburst API Call in Python