The Rise of SQL

It’s become the second programming language everyone needs to know

3 min read
sql computer programming language on screen
iStock

SQL dominated the jobs ranking in IEEE Spectrum’s interactive rankings of the top programming languages this year. Normally, the top position is occupied by Python or other mainstays, such as C, C++, Java, and JavaScript, but the sheer number of times employers said they wanted developers with SQL skills, albeit in addition to a more general-purpose language, boosted it to No. 1.

So what’s behind SQL’s soar to the top? The ever-increasing use of databases, for one. SQL has become the primary query language for accessing and managing data stored in such databases—specifically relational databases, which represent data in table form with rows and columns. Databases serve as the foundation of many enterprise applications and are increasingly found in other places as well, for example taking the place of traditional file systems in smartphones.

“This ubiquity means that every software developer will have to interact with databases no matter the field, and SQL is the de facto standard for interacting with databases,” says Andy Pavlo, a professor specializing in database management at the Carnegie Mellon University (CMU) School of Computer Science and a member of the CMU database group.

The use of SQL within streaming systems opens up a new chapter.

That sentiment is echoed by Torsten Suel, a professor and director of undergraduate programs in computer science and engineering at the NYU Tandon School of Engineering. “A lot of our technological infrastructure uses relational databases to store and query their data, and while not the only way, SQL is still considered the main way—or most powerful way—to interface with relational databases,” he says.

Beyond the utility of databases in themselves, big data and the growth of streaming architecture are contributing to SQL’s rise. “Markets such as retail, e-commerce, and energy are seeing growing interest in applications where data has to be processed and analyzed in real time,” says Manish Devgan, chief product officer at real-time data platform Hazelcast. “The use of SQL within streaming systems opens up a new chapter in the story of SQL within the data domain.”

Even the fields of data science and machine learning are propelling SQL to the top. “We have this huge boom in data science and machine learning, and students focusing on these fields during their studies often also take a database course, which usually involves learning SQL,” says Suel. “So it could be a side effect of the data-science-and-machine-learning boom.”

Consequently, even if you mostly program in, say, Python or C++, it’s increasingly important that your application can talk to an SQL database. “Most of the software we develop depends on relational databases, and we rely on SQL,” says Andrey Maximov, chief technology officer at the Web development agency Five Jars. “The development process often goes through setting requirements and specifications, which very much comply with the ideas of relational databases.”

The existing software and tooling ecosystem that relies on SQL is vast.

This means learning SQL will benefit your career as a programmer—and it’s a fairly intuitive language to pick up. “SQL is a mature technology,” says Maximov, who has been a developer for more than a decade and has extensive experience in SQL programming. “It’s taught in colleges and universities, and it’s really easy to learn.”

SQL has been around since the 1970s, with computer scientists from IBM developing Sequel, the first version of the language. It was standardized more than a decade later, and new versions of the SQL standard continue to be published. “The SQL standards body has done an excellent job adapting to emerging technology trends and expanding the language over the decades,” Pavlo says. “And the existing software and tooling ecosystem that relies on SQL is vast.”

Having been around for more than 50 years, SQL has seen new technologies arise to challenge its enduring power. “Reports of the impending death of SQL used to be quite a regular occurrence over the years, especially with the rise of the NoSQL movement,” says Devgan. NoSQL refers to a type of database developed in the late 2000s that stores data in a format other than tables, such as documents or graphs with nodes and edges. Even tech giants like Google experimented with NoSQL. The company initially designed its database service, Cloud Spanner, as a NoSQL database, but soon realized it needed a robust and expressive query language, so it turned back to SQL.

“Every decade, another hyped-up database technology comes along that claims SQL is terrible, slow, or impractical,” Pavlo says. “Over time, the conventional wisdom comes back to realizing that [SQL] is a good idea, and everyone returns to it.”

The Conversation (2)
Richard Hoek
Richard Hoek14 Sep, 2022
INDV

We (at Tracy Data Solutions) totally agree with the statement "The Rise of SQL". We have built a tool in the form of a web application which is designed to create Enterprise Software Solutions. In fact the tool *is* the beginning of the Enterprise Software Solution itself! This tool enables everyone with *only* just some understanding of SQL to build Online Enterprise Database Solutions for SQL Server. The tool is called TSQL.APP and the first-ever Solution we have built with it in 2021 is in use by 3 trading companies (import & export of fruit & vegetables) and has already processed tens of thousands of orders with a turn-over of more than 200 Million EURO in the first year.The technology is based on .NET Core and can be hosted on Linux and Windows Servers using SQL-Server as database

Ronald Perrella
Ronald Perrella17 Nov, 2022
INDV

Looking back over my 30+ year career, the two constants have been Unix and SQL. Languages and paradigms have come and gone but SQL remains a powerful tool, which demonstrates the value of a declarative, data centric language, whether or not it is applied to a traditional relational database. It's a very safe bet that it will continue to be a presence in this industry for the foreseeable future.