Welcome to our blog! Welcome to our blog!

SILQ Makes Offloading SQL Workloads to Hadoop a Very Smooth Process!

Ever needed an easy button to sift through 1000s of lines of legacy SQL code written over many years? SILQ is it! SILQ is a one of a kind technology to help you visualize, understand and offload complex SQL data integration workloads from your data warehouse to Hadoop. Why is this important? Because as organizations look to shift heavy Extract-Load-Transform (ELT) workloads from expensive data warehouses into Hadoop, the first barrier they need to overcome is making sense of these thousands of lines of SQL code.

SILQ’s unique capabilities have been extremely well received in the marketplace. In fact, many of Syncsort’s customers are already using it today. Some of challenges SILQ solves are – little or no documentation for SQL code, SQL developers who have written the code have left the company, spaghetti code that has been enhanced over the years and has become quite a mess, 25000 lines of code in a SQL script, where do I start? As the name suggests, SILQ makes it a significantly smoother process to digest complex SQL versus manually reading and converting scripts.

(SILQ is now available free on our website.  Try it today!)

Here is an example -it can take a skilled SQL developer up to 20 hours to manually document an average complexity script that has about a 1000 lines of SQL. SILQ helps you visually understand and analyze it in minutes, so you can accelerate your EDW Offload projects. With SILQ the same developer can automatically generate a fully documented chart and understand the same 1000 line SQL script in 30 minutes or less.

Watch this video to see SILQ in action!

So what does SILQ offer in terms of technical capabilities? SILQ supports parsing ANSI SQL 2003-compliant code and some database extensions, such as Teradata BTEQ, Oracle PL/SQL and Netezza SQL. SILQ can display the SQL in a formatted, indented and easy to read editor as you can see in the graphic. The graphic also shows you the visual flow chart that can then be displayed allowing the user to understand the flow and sequence of the SQL. A picture speaks a thousand words and that is what SILQ is giving you versus having to manually read through code. The flow chart breaks the SQL into functional blocks. Users can then drill down on each block in the flow chart to get further detail and analysis including documented and actionable recommendations, best practices and advice to implement the same logic for your EDW offload project using Syncsort’s products: DMX and DMX-h.

SILQ captures high-level SQL commands such as SELECT, JOIN, UNION, MERGE, ORDER/GROUP BY, UPDATE, INSERT, CREATE TABLE, CREATE INDEX, CREATE VIEW, CREATE CAST, CREATE SCHEMA DELETE, FUNCTION, PROCEDURE, PARTITION, OVER,  QUALIFY, HAVING, WHERE, WINDOW, and CURSOR. It also parses several high level SQL constructs, like IF/THEN statements, CASE statements and BEGIN/END. This is in no-way an exhaustive list of constructs, just a subset to give you an idea of its power.

To learn more and try SILQ for yourself, visit www.syncsort.com/SILQ.

Nikhil Kumar

Authored by Nikhil Kumar

Big Data Technical Product Manager
0 comments

Leave a Comment

*