Edit: abc import is featured on https://www.producthunt.com/posts/x-to-elasticsearch-sync.

We have built abc import to address the problem of indexing and syncing data from source X into Elasticsearch (and appbase.io) via convenient CLI commands. It works today with MongoDB, Postgres, MySQL, SQL Server, JSON and CSV file formats.

abc import is part of abc — A tool that allows accessing appbase.io via a commandline.

Key Benefits

Whether your data resides in Postgres or a JSON file or MongoDB or in all three places, abc can index the data into Elasticsearch. It is the only tool that allows working with all these sources at once or individually: csv , json , postgres , mysql , sqlserver , mongodb , elasticsearch . It can keep the Elasticsearch index synced in realtime with the data source. Note: This is currently only supported for MongoDB and Postgres. abc import is a single line command that allows doing all of the above. It doesn’t require any external dependencies, takes zero lines of code configuration, and runs as an isolated process with a minimal resource footprint. abc also supports configureable user defined transformations (think better ETL) for advanced uses to map data types, columns or transform the data itself before the data gets indexed into Elasticsearch.

See `abc import` in Action

Here, we show a realtime indexing example of using abc to sync MongoDB data with Elasticsearch.

You Should Use This If…

If you work with a SQL database and require a great search functionality but have been hesitating to use a search index because of the database ETL hell, abc has got you covered.

abc is the only tool that supports all of these data formats today.

If you currently use application logic to write data to your source database and sync it with Elasticsearch, you should consider using abc instead. Because it directly indexes from the database, it avoids a ton of false sync issues. By running the sync as a separate process, you create operational simplicity.

Get abc

Download the binary of v0.4.1 release for MacOS, Linux or Windows. After that put the binary in a folder of your choice. You can put it in PATH so that it can be called from anywhere. Then test the installation as

> abc version

abc is also available as a docker image.

docker pull appbaseio/abc

Read the following guides for specific examples of using abc.

Postgres

MongoDB

MySQL

Microsoft SQL Server

Elasticsearch

JSON

CSV

Firestore

Summary

Some parts of abc are open source and the source code is available on GitHub. The program has been written in idiomatic Go. Show us your love by starring the repo. And try out appbase.io if you have not done so already, it’s a super easy service to have your own streaming NoSQL database on the cloud.