I'm using Talend Open Studio from 2 years now and its perfect to integrate files with your BDD.
I've done many applications with this ETL in order to read from a file and write the data in a BDD (one or many BDD to write in the same job).
Very good software
Easy to use
No need to "hard" code in order to have your job done
Easy to integrate with many technologies of BDD (MySQL, noSql and many more)
Easy to integrate with many kind of files (csv, xls, xlsx)
There's a lot of forum with people that's willing to help if you know how to ask
There's a lot of components, in order to manage everything in this software you will have to do to many formations.
Enterprise Level Data Integration Software
Our big data projects are based on Talend platform for our pipeline processing. To handle the exception properly, we designed a complex multi-master handling process to make sure the runtime exception can be resumed automatically. Other than that, Talend fulfilled our needs properly and their support were cooperative and working hard.
1. Open source;
2. Full of transformations to support different scenarios;
3. Convenient designer/java code switching capability for troubleshooting;
4. Integrated with java, maven, nexus;
5. Integration support with Big Data and MDM.
1. When project is big, the designer is becoming slower and slower;
2. The exception handling not convenient. You can either let go the exception or stop the process, or using external controller to resume the applications. But you cannot customize the try catch block of the exception itself;
3. Nexus integration is buggy on talend 7.
Use talend in the company to implement integrations between systems.Using both Web services and file
Ease of learning. Development can be done by writing a few lines of code or in any case with very basic java knowledge.
Graphically it is possible to write writes or readings in the database, writings or readings on file.
Talend already provides default connectors with other systems. Such as Google Cloud, Excel, MySql, Oracle and many others.
The version for mac is horrible. Sometimes you have to use "Ctrl" sometimes "Cmd" is really badly done.
In my experiences the speed of learning clashes with the consumption of resources and the slowness of the interfaces.
An interface made in pure Java requires more time to implement but is definitely more performing.
Talend is flexible and can do many task for Data Engineers
Talend was the go to for our team since it allowed easy access to other Data Bases systems as Oracle and no-sql db's as well.
I like that it is based on open source technology. The Integrated development environment (IDE) is Eclipse based so if you are familiar with Java IDE you will feel right at home.
If you are primarily a Windows workshop there will be a learning curve to moving around Talend's IDE. Some task might not be as intuitive if you are only familiar with MSSQL based products.
When you need to beam your data from one database or format to any other format or database
Talend Data Integration is an open source application, available in free and paid premium versions, which saves an enormous amount of time and provides you with the ability to setup and automate most of the work needed to sync data from one application or database to another application or database. It's easy to drag an drop lines between pre built components for almost every data base or format or data source known to mankind, click automap to map the corresponding fields. The paid version is great because of the level of support provided by the company, plus they also offer hosting and team collaboration features to let a group of people share with their fellow team members any recipes for extracting and loading data.
Talend Data Integration has a great set of features. Plus, the company behind the software has earned one of the best reputations and most respect in the realm of data integration and big data. The software user interface is very good to great and takes a short time to explore and get used to it. There is an online community for discussing with other users, or plenty of consultants and developers available if you want to outsource that work. Based on java, it's industrial strength and and army of java pros is available if and when you want.
Talend is a Windows desktop app running on top of the Eclipse development environment, so you need a several hundred MB of ram and disk space to run the application comfortably.
review of talend data fabric
I have used talend data fabric is working with database development and loading batch jobs. My department is using this software less and less now.
Talend data fabric can run and integrated many batch jobs at the same time. it is effective when a lot of loads need to be completed.
Talend data fabric is oftentimes very slow. It is also very particular. Everything step has to be exact or else the whole program will spew out errors.
Talend Open Studio DI
I've been working with Talend Open Studio Data Integration for more than 5 years, in easy and complex projects that include data extractions, transformations, and load.
You can download a community version and test it for as long as you want, then decide to switch to a paid enterprise version, or keep using the community without cost.
There is an respectable list of components available, also an additional list of components provided by users and developers called "Talend Exchange" can be added to your projects.
Easy to learn, there are videos, manuals, and forum.
Very responsive user community.
Need more marketing as a company.
Review of Talend DI and ESB .. and TAC
Have used Talend pretty heavily for past 5 years ..
Medium size gas and oil company .. ~2500 employees ..
Overall pretty good product ..
Like the Admin console to overview process results and run adhoc re-runs.
Java based .... Eclipse under the covers ..
can migrate work from Free studio to Integration suite ..
SVN usage ..
Can grow number of processes ... 200+ ..
Can start with free version ..
Has admin console.
Can be hosted by either Linux servers ... or windows servers ..
need to know some Java ... this isn't really a con I guess ...
support fairly good ... might expect even more from support ..
Excellent Data Integration tool with support for many Heterogeneous Systems :Oracle, AWS , Big Data
1) Extensive Components to support Integration with multiple systems: Oracle ,AWS, Big Data
2) Does have Data Quality , Data Preparation , MDM , ESB Integration suite
1) Talend is completely Java based and have seen stability issues
2) Need to have the option to convert Data profiling analysis to Talend Job.
Best cross database ETL tool
Talend help us to perform ETL task between different databases. This help us to see more opportunities from our data.
I like the most on this software is the capability to perform ETL job on different database type like MSSQL to MySQL, RDBMS to NoSQL and even on Big Data platforms such as hadoop.
I dont like on this software is the IDE. It not beginner friendly.
Best for data wrangling in ETL for any process
I have solved many business problems and provided a necessary solution using Talend which helped in integrating multiple programs in to one place, getting to know more on the Big data is must which has more and more useful things
This tool has custom components which helps in solve all the business problems like TikaPDF extractor and many more also the integration between other components is very easy
Most of the powerfull components are paid cant find in custom components and also sometimes it very hard to run complex ETL jobs gets slow in V7
Its an efficiently and effectively manage my data sets.
Efficiently and effectively way to manage Variant data
This App has created a reputation for your company since it has enabled users to integrate and manage large volumes of data therefore reducing their workload
The need to refresh on Java, though on the other hand it has made me remember a few concepts that would soon fade away from my mind.
Useful, fast and vary, that's what you need!
We integrated it with Salesforce and many other services through its connectors. It's very fast and easy to use even if you have to get used to it, and it might not be easy at first.
It can become incredibly complicated to handle complex fluxes, and if you are facing issue or getting unexpected results it can be quite hard to debug and find the problem.
Data integration software with a lot more feature
At the end of the day successfully migrate data in from one database to another which is hosted on server. Linking of relational tables are easy than expected.
This software provide you ease of access for usage. Here you can easily communicate with 2 database with weather it is on local or server. You can communicate both with different features as well. Apart from that you can also easily transfer with just UI.
One of the main issue is if you have security key rather than password than there is a lot more external process needed to connect. Also you can only connect 2 database at a time for data transfer.
Talend - Far above its Peers
Talend is phenomenal at bridging the data gap between two disparate (or like) data sources. One way we've used Talend in the past was to bring data from Marketo into NetSuite, and one way we're using it now is to bring data from SFDC, Netsuite (for Finance) and Marketo into Tableau for optimized reporting.
Within Marketo, I've personally used Talend to update campaign flow steps in bulk, that otherwise would have been manual. Huge time saver.
unified platform, predictable pricing, and plethora of connectors
That I didn't think of the idea.
Telend is powerful software with cheaper cost
overall I can suggest it to use it is most powerful and cheaper solution.
custom components are allowed to extend the functionality as per project needs.
Designing and developing jobs and schedules are easy and pretty straightforward.
Source control with git and integrating with Git is not that easier.
found some runtime issues which support took long time to resolve it.
Useful for first foray into big data
It has free version and can do majority of the work. Overall easy to work with. Has forum and community support. Has many components.
It is not always so intuitive, need to learn java, but at the same time, it is flexible. Nothing bad to say.