Browsing: application

In this post, I will show how to build an AI assistant that mines this large amount of information easily. You’ll ask it your questions in natural language and it’ll answer according to relevant papers it finds on Papers With Code.

On the backend side, this assistant will be powered with a Retrieval Augmented Generation (RAG) framework that relies on a scalable serverless vector database, an embedding model from VertexAI, and an LLM from OpenAI.

On the front-end side, this assistant will be integrated into an interactive and easily deployable web application built with Streamlit.

Every step of this process will be detailed below with an accompanying source code that you can reuse and adapt👇.

Ready? Let’s dive in 🔍.

If you’re interested in ML content, detailed tutorials, and practical tips from the industry, follow my newsletter. It’s called The Tech Buffet.

The encrypted-messaging service Signal is the application of choice for dissenters around the world. The app has been downloaded by more than 100 million users and boasts high-profile endorsements from NSA leaker Edward Snowden and serial entrepreneur Elon Musk. Signal has created the perception that its users, including political dissidents, can communicate with one another without fear of government interception or persecution.

But the insider history of Signal raises questions about the app’s origins and its relationship with government—in particular, with the American intelligence apparatus. Such a relationship would be troubling, given how much we have learned, in recent years, about extensive efforts to control and censor information undertaken by technology companies, sometimes in tandem with American government officials.

First, the origin story. The technology behind Signal, which operates as a nonprofit foundation, was initially funded, in part, through a $3 million grant from the government-sponsored Open Technology Fund (OTF), which was spun off from Radio Free Asia, originally established as an anti-Communist information service during the Cold War. OTF funded Signal to provide “encrypted mobile communication tools” to “Internet freedom defenders globally.”

Some insiders have argued that the connection between OTF and U.S. intelligence is deeper than it appears. One person who has worked extensively with OTF but asked to remain anonymous told me that, over time, it became increasingly clear “that the project was actually a State Department-connected initiative that planned to wield open source Internet projects made by hacker communities as tools for American foreign policy goals”—including by empowering “activists [and] parties opposed to governments that the USA doesn’t like.” Whatever the merits of such efforts, the claim—if true—suggests a government involvement with Signal that deserves more scrutiny.

The other potential problem is the Signal Foundation’s current chairman of the board, Katherine Maher, who started her career as a U.S.-backed agent of regime change. During the Arab Spring period, for instance, Maher ran digital-communications initiatives in the Middle East and North Africa for the National Democratic Institute, a largely government-funded organization that works in concert with American foreign policy campaigns. Maher cultivated relationships with online dissidents and used American technologies to advance the interests of U.S.-supported Color Revolutions abroad.

Maher then became CEO of the Wikimedia Foundation in 2016, and, earlier this year, was named CEO of National Public Radio. At Wikipedia, Maher became a campaigner against “disinformation” and admitted to coordinating online censorship “through conversations with government.” She openly endorsed removing alleged “fascists,” including President Trump, from digital platforms, and described the First Amendment as “the number one challenge” to eliminating “bad information.”

According to the insider, a woman named Meredith Whittaker, who became president of the Signal Foundation in 2022, recruited Maher to become board chair because of their mutual connections to OTF, where Maher also serves as an advisor, and to nonprofits such as Access Now, which “defends and extends the digital rights of users at risk around the world,” including in the Middle East and North Africa. Whittaker, like Maher, is highly ideological. She previously worked in a high position at Google and organized left-wing campaigns within the company, culminating in the 2018 “Google Walkout,” which demanded MeToo-style sexual harassment policies and the hiring of a chief diversity officer.

So what does all this mean for American users—including conservative dissidents—who believe that Signal is a secure application for communication? It means that they should be cautious. “Maher’s presence on the board of Signal is alarming,” says national security analyst J. Michael Waller. “It makes sense that a Color Revolutionary like Maher would have interest in Signal as a secure means of communicating,” he says, but her past support for censorship and apparent intelligence connections raise doubts about Signal’s trustworthiness. David Heinemeier Hansson, creator of the popular Ruby on Rails web-development framework, agrees, saying that it had “suddenly become materially harder” to trust the Signal Foundation under Maher’s board leadership.

For those who believe in a free and open Internet, Maher’s Signal role should be a flashing warning sign. As she once explained, she abandoned the mission of a free and open Internet at Wikipedia, because those principles recapitulated a “white male Westernized construct” and “did not end up living into the intentionality of what openness can be.” The better path, in her view, is managed opinion, using, alternately, censorship and promotion of dissent—depending on context and goal—as the essential methods.

We’re entering a dangerous period in political technology, and Maher is in the thick of it. Under her ideology, “Internet freedom” is a tactic, not a principle, and “fighting disinformation” means speech suppression, including here at home. When people tell you who they are, believe them.

Photo by Jaap Arriens/NurPhoto via Getty Images

OpenAI introduced ChatGPT in November 2022, sparking a tremendous amount of interest in artificial intelligence. ChatGPT gained so much attention that generative AI (GenAI) became a dominant theme in the tech world in 2023.

Microsoft backed OpenAI at the start of 2023 by pledging a multimillion-dollar, multiyear investment to accelerate OpenAI’s development of its AI technology.

Google made its GenAI move in March 2023 with Bard. In February 2024, Google rebranded Bard as Gemini when it debuted an improved version of the AI chatbot.

ChatGPT and Gemini are largely responsible for the considerable buzz around GenAI, which uses data from machine learning models to answer questions and create images, text and videos. OpenAI and Google are continuously improving the large language models (LLMs) behind ChatGPT and Gemini to give them a greater ability to generate human-like text.

GenAI is still rapidly evolving, and models don’t always return correct answers. Despite the common occurrence of AI hallucinations — wrong answers generated by AI — in both ChatGPT and Gemini, the tools are being adopted by businesses and consumers seeking to automate time-consuming tasks.

What is Google Gemini?

Gemini is Google’s GenAI model that was built by the Google DeepMind AI research library. The Gemini AI model powered Google’s Bard GenAI tool that launched in March 2023. Google rebranded Bard as Gemini in February 2024, several months after launching Gemini Advanced based on its new Ultra 1.0 LLM foundation. In May 2024, Google first offered users of Gemini Advanced access to the newer Gemini 1.5 Pro model.

Gemini is designed to retrieve information as a simple answer, similar to the way smart assistants like Alexa and Siri work. It uses LLMs to reply to prompts with information it has already learned or can retrieve from other Google services.

Google Gemini is multimodal — it understands audio, video and computer code as well as text. Google has paused Gemini’s image generation feature because of inaccuracies, however. Google’s statement disclosing the pause pledged to re-release an improved image generation feature soon.

Gemini’s capabilities are integrated into Google’s search engine and available in Google Workspace apps such as Docs, Gmail, Sheets, Slides and Meet. Gemini for Google Workspace is the new name for Duet AI for Google Workspace, which was Google’s answer to the Microsoft Copilot AI assistant. Google Gemini is available through an app on Android phones and in the Google app on iOS.

Gemini Advanced is part of the Google One AI Premium plan subscription service that costs $19.99 per month in the United States. Google One AI Premium also includes 2 TB of storage.

Gemini Advanced is a more powerful AI version than Gemini Pro, which remains available for free. Gemini Advanced with Gemini Pro 1.5 provides a large context window of 1 million tokens, enabling analysis of larger data sets.

Google suggests Gemini Pro and its AI capabilities is the better choice for development, research and creation tasks, and if you’re looking for a free chatbot. It brings AI to simple tasks for personal use. For those willing to pay the subscription fee, Google recommends Gemini Advanced for professional applications, more demanding workflows, enhanced performance and more cutting-edge capabilities. Google Advanced will also include early access to new features.

Gemini Nano, another part of the Google Gemini family, is used in devices such as Google’s Pixel 8 Pro smartphones.

What are the main differences between Gemini and ChatGPT?

ChatGPT and Google Gemini have become increasingly similar. Both have a free service, a nearly identically priced subscription service, and similar interfaces and use cases. The differences are largely under the hood — in their language models.

They’re also used for many similar functions, and work by users typing in a query to get a response. Both raise privacy concerns about how user data can be used. However, they differ in their training models, data sources, user experiences and how they store data.

Training models

ChatGPT is built on OpenAI’s GPT-3.5 or GPT-4. Gemini has three sizes: Gemini Pro for a wide range of tasks, Gemini Ultra for highly complex tasks, and Gemini Nano for mobile devices. Gemini Pro 1.5, which powers the subscription Gemini Advanced version, is faster and more advanced than the model used for the free Gemini service.

Data sources

The main difference between ChatGPT and Gemini is the data sources used to train their LLMs. GPT-4o uses predefined data that goes up to October 2023. Gemini draws on data pulled from the internet in real time. It is tuned to select data chosen from sources that fit specific topics such as coding or the latest scientific research.

User experience

ChatGPT users can log onto the free ChatGPT with any email account. ChatGPT also includes an API that developers can use to integrate OpenAI LLMs into third-party software. It lacks a Save button, but users can copy and paste answers from ChatGPT into another application. It does have an Archive button that can list previous responses in ChatGPT’s left-hand pane for quick retrieval.

Because ChatGPT is text-based, it can’t include images, videos, charts or links in its answers. It also lacks the ability to search the internet.

Because of OpenAI’s close partnership with Microsoft, ChatGPT can be used through Windows apps such as Word, Excel, PowerPoint and Outlook. Also, Microsoft’s Copilot AI assistants use the GPT-4 language model.

Gemini Pro’s interface gives users a chance to like or dislike a response, opt to modify the size or tone of the response, share or fact-check the response, or export it to Google Docs or Gmail. Gemini also has a “review other drafts” option that shows alternate versions of its answer. Gemini also lets users upload images, but its ability to create images is on hold until Google improves that feature.

Data storage and privacy

Both ChatGPT and Google Gemini store user data.

ChatGPT stores all prompts and queries entered. Users can review previous conversations through its archive feature. Although users can delete responses and conversations, the chatbot might continue to use these responses in its LLM for training. This raises privacy concerns when users enter personal data or proprietary information. OpenAI also discloses that ChatGPT gathers geolocation data, network activity, contact details such as email addresses and phone numbers, and device information.

According to OpenAI’s privacy policy, it collects any personal information a user provides. This includes account information such as name, contact information, payment card information and transaction history. OpenAI also might disclose geolocation data to third parties such as vendors and service providers, and to law enforcement agencies if required to do so by law.

OpenAI said the user retains ownership rights of input data and owns the output, but it “may use Content to provide, maintain, develop, and improve our Services, comply with applicable law, enforce our terms and policies, and keep our Services safe.”

Gemini stores conversations in a user’s Google account for 18 months, but users can change the retention period to three months or 36 months in their activity settings. Gemini conversations can also appear in searches, raising privacy concerns.

Google discloses that it collects conversations, location, feedback and usage information. The Google Privacy Policy claims Google uses collected data to develop, provide, maintain and improve services, and to provide personal services such as content and ads. Customers can delete information from their account using My Google Activity, or by deleting Google products or their Google accounts.

Google said it will share information to third parties with user consent and law enforcement when required.

Which chatbot is better?

There is a bit of a GenAI arms race going on now, with OpenAI and Google making updates to their models. Google has been especially aggressive, perhaps because ChatGPT came out first and Gemini must play catch-up. With each new version of the LLMs, Google and OpenAI make significant gains over their previous versions.

Generally, ChatGPT is considered the best option for text-based tasks while Gemini is the best choice for multimedia content. However, there are other considerations, as noted in earlier sections of this article. Users can try the free versions to determine which works better for them.

There have been several in-depth reviews about the chatbots worth noting:

• Researchers from Carnegie Mellon University and BerriAI benchmarked Gemini Pro against GPT-3 and GPT-4 on 10 diverse language tasks with the goal of providing an impartial in-depth analysis. They found Gemini’s strengths included performance on long, complex reasoning chains and translating into non-English languages. On the downside, it struggled with mathematical reasoning — especially with large numbers — showed bias on multiple choice questions and aggressive content filtering blocked many responses. In summary, the researchers concluded Gemini Pro did not match GPT-3 and GPT-4, but “exhibits strengths in handling complexity and reasoning depth.”
• Ethan Mollick, an associate professor who studies AI at the Wharton School of the University of Pennsylvania, performed what he called “tasting notes” of Gemini Advanced vs. GPT-4. Mollick concluded that Gemini Advanced is the first advanced AI model that can compete with GPT-4. He said each has its strengths and weaknesses — for example, GPT-4 uses code in a more sophisticated way and is better at hard verbal tasks while Gemini is better at explanations and search. But both “are weird and inconsistent and hallucinate more than you would like.”
• Bernard Marr, a futurist and author of Generative AI in Practice, pointed out in a Forbes article that ChatGPT is designed to be more conversational while Gemini processes information and automates tasks more efficiently. Marr’s conclusion after using ChatGPT and Gemini is that ChatGPT-4 is the more powerful chat interface but “Gemini is closing the gap …”.
• Neither ChatGPT nor Gemini are perfect, and their developers admit that. Both generate hallucinations and even warn users of that in their responses.
• Both of the chatbots include a disclaimer on the bottom of their prompt screens. Gemini’s reads: “Gemini may display inaccurate info, including about people, so double-check its responses.” ChatGPT advises: “ChatGPT can make mistakes. Consider checking important information.”
• The Gemini FAQ on Google’s website offers this valuable advice that can apply to all AI tools:
  • Gemini can’t replace important people in your life, like family, friends, teachers or doctors.
  • Gemini can’t do your work for you.
  • Gemini can’t make important life decisions for you.

Generative AI alternatives

GenAI is a fast-moving technology. Besides the updates to ChatGPT and Google Gemini, other companies are working on AI projects. These include AI21 Labs’ Wordtune, Anthropic’s Claude, Glean, Jasper, Open Assistant and Writesonic’s Chatsonic. China’s Baidu search engine uses AI with an application called Ernie Bot. Many productivity applications and SaaS products also incorporate GenAI assistants.

Comparison of ChatGPT vs. Gemini responses

We asked ChatGPT 3.5 and Google Gemini Pro the same requests and prompts to see how their responses would compare. The results are as follows:

Idea generation

Prompt: What are the five hottest IT trends an IT professional should know about?

Thoughts: ChatGPT’s answers were more general while Gemini drilled down into specific areas — for example, generative AI vs. AI/ML and cybersecurity mesh vs. cyber security. ChatGPT’s inability to reference data past January 2022 limits its effectiveness when looking for trending information. Gemini snuck in a few extras under “Bonus trends.”

Creating content

Prompt: Write a two-paragraph summary explaining cyber-resiliency challenges.

Thoughts: Both did a good job of explaining and summarizing a complex issue in two paragraphs, but Gemini included more specifics about the challenges and what can be done about them.

Planning

Prompt: What are the best cloud computing conferences to attend?

Thoughts: ChatGPT listed more conferences, but its list was a bit dated as several of its conferences have been renamed. Gemini offered greater detail and broke its list into specific areas of expertise.

Developer assistance

Prompt: List 10 frequently used SQL queries for querying a PostgreSQL database.

Thoughts: The lists were similar, although they used different terms in some cases. A nice feature was the code embedded in the responses. We shortened Gemini’s response to fit on one page, but its longer version included embedded code.

Dave Raffo is an independent IT analyst and journalist. He previously worked as a senior analyst at The Futurum Group and Evaluator Group, covering integrated systems, software-defined storage, container storage, public cloud storage and as-a-service offerings. He previously worked at TechTarget from 2007 to 2021 as executive news director and editorial director for its storage coverage, and he was a technology journalist for 30 years.