❄️ Introducing the LocalStack Snowflake extension (experimental)

Hi all,

About a year ago we have released the first version of LocalStack Extensions: Extensions are a powerful mechanism to plug additional functionality into LocalStack - ranging from additional service emulators, to value-add features like Chaos Engineering, request logging, cloud resource replication/proxying, and more. An initial list of extensions can be found in this repository as well as in the LocalStack Web app.

Over the last couple of months we have been experimenting with a LocalStack :snowflake: Snowflake emulator extension, which allows to develop and test your Snowflake data pipelines entirely on your local machine!

Below is a simple sample snippet that illustrates how you can use the Python Snowflake client library to connect to the the Snowflake emulator running on your local machine (note that the hostname snowflake.localhost.localstack.cloud resolves to a local IP address):

connection = snowflake.connector.connect(
    user="test",
    password="test",
    account="test",
    database="test",
    host="snowflake.localhost.localstack.cloud",
)
connection.cursor().execute("CREATE TABLE table1(col1 INT)")

This extension is still highly experimental and covers only a small subset of the Snowflake API and functionality - although some of the key features are already available today, including:

Below is a sneak preview of the extension running in LocalStack, and using DBeaver to connect to it and run Snowflake SQL queries against it:

We are currently looking for early adopters who would like to give it a try with this extension, provide feedback on the current functionality, and help us shape the roadmap going forward.

If you’re interested in learning more, please reach out to us directly - either in this thread, or via DM, or via email to info@localstack.cloud .

We’re looking forward to getting your feedback and learning more about your use cases for developing & testing data pipelines locally with Snowflake!

2 Likes

Hi @whummer , Does this extension support Snowflake Java libraries or JDBC?
If yes, could you please share documents to get started with it?

Hi @harindra , yes it does support Java libraries and JDBC.

We do not have extensive documentation for the extension yet, unfortunately, as it is not generally available yet. Can you please reach out to us via email (info@localstack.cloud), or in our Community Slack channel (Slack) - happy to discuss the next steps there to give you access. Thanks!

Hi @whummer, I am interested in testing out your Snowflake extension to see how it integrates with my service.
I found this localstack-extension-snowflake - pypi Package Security Analysis - Socket and have already installed the extension. Can you please guide me on how to enable Snowflake service and how to check if Snowflake is working properly?

1 Like

Does your tool allow for testing of Dynamic Tables, Streams, Tasks?

1 Like

Hi @whummer, I would also be greatly interested in trying this feature. I’ll send an email,
Thanks,

1 Like