The Brain Behind the Much-Needed Multilingual Text Line Detection Model

A multilingual optical character recognition (OCR), which goes by the name Surya(aka Sun) has been making a lot of noise on X (formerly Twitter), as well as on GitHub and Hugging Face for all the right reasons. “Nice. This used to be really, really hard,” said Meta AI’s chief Yann LeCun.

Surya—a multilingual text line detection model designed for document OCR, has been trained on diverse documents, including scientific papers. The training ensures that Surya excels in detecting text lines within documents, delivering pinpoint accuracy in line-level bounding boxes and clear identification of column breaks in PDFs and images.

AIM got in touch with Vik Paruchuri, the creator of Surya, who highlighted the model’s versatility at length, asserting that it works seamlessly with every language tested. In India, its scope is huge.

“I think Surya has the potential to vastly increase how much of that data is available,” referring to the dearth of Indian language datasets, especially in regions where the majority of content is not on the web, particularly low resource indic languages.

“So this model can protect texts in all Indian languages,” he added, saying that the impact on Indian LLMs would be substantial. That makes sense, as Surya promises to be a valuable asset for detecting and recognising text in regional languages.

Gaining feedback and appreciation, particularly from the likes of LeCun and others, Paruchuri with a smile said: “It’s just a huge honour, and I can’t get over the fact that he took a look at it.”

Inception of Surya

Paruchuri—a former US diplomat, shared his journey with AIM. It’s truly inspirational.

“I’m a self-taught data scientist, and started a company called Dataquest that teaches data science and AI, which I ran for a long time.” Reflecting on his shift in focus, he added, “I stepped back last year to focus more on building, to work on AI. I spent a lot of time learning about AI and started just training models and experimenting.”

Paruchuri reiterated the significance of data quality in model training, stating, “I realised that data is the biggest limiting factor for many of these models. The better your data, the better your model is going to be. But not enough people are working on the data quality issue.”

Committed to addressing this challenge, he decided to concentrate on training models in this domain, emphasising the importance of open-source data and tools. He said, “You need open-source data and tools to be able to train. Really, really don’t want that to be restricted to the companies like OpenAI.”

Paruchuri, a passionate proponent of open-source, left his company, which has reached a million people and helped learn data science to build something worthwhile.

“I didn’t know if I’d be able to build something useful or even if I could learn deep learning, so it’s been amazing actually to see people using my libraries and finding them useful,” said Paruchuri—-who also hailed Hugging Face as a great company.

This is huge because, Google’s Tesseract has long been dominating the OCR. Surya can be a better alternative.

Tech Stack

Paruchuri told AIM that he employed a modified segformer architecture from NVIDIA, using a transformer for text line detection, particularly the encoder and decoder technique to turn an image into text.

“The text line detection model uses an encoder, employing an architecture called ‘former,’ which uses an encoder to encode the image and then a decoder to give you a mask that tells you where the text is,” explained Paruchuri, saying, “They all use PyTorch and Hugging Face transformers.”

Paruchuri further explained that the model underwent training on a mix of real and synthetic documents, incorporating about 2 million images with associated labels. The model was also trained from scratch, boasting approximately 100 million parameters.

Paruchuri also mentioned that the performance of Surya was validated across various languages using the known data set “doclaynet,” demonstrating its effectiveness in diverse linguistic contexts.

What’s next?

Paruchuri built his model using NVIDIA’s RTX A6000 for training in the middle of the GPU crunch and is of the opinion that “there’s a lot of spaces where you can train like 100 million state-of-the-art parameter models.”

Surya could be used in different industries with a lot of documents and be used to design better AI models or extract data that could be used in services.

He also mentioned that he would like to release his datasets eventually to aid this.

This, in turn, could aid the efforts being made in India by several initiatives like Bhashini, AI4Bharat at IIT-Madras; Project Vaani, Sarvam AI’s OpenHathi series, and CoRover.ai’s BharatGPT in building LLMs trained specifically in Indian languages.

India boasts over 400 languages and a rich linguistic tapestry but faces the challenge of bridging the digital divide exacerbated by the dominance of English in LLMs. Amitabh Nag, CEO of the Indian government’s Bhashini, has also said that despite the progress made by Bhashini, acquiring local datasets remains a formidable challenge.

Nag revealed that many of the 22 official Indian languages lack digital data, hindering AI model development. Surya can help bridge the gap, help India lead in the AI race, and potentially create millions of jobs in data labelling and annotation.

The post The Brain Behind the Much-Needed Multilingual Text Line Detection Model appeared first on Analytics India Magazine.

Google Introduces Video Generation Model Lumiere, Leaves OpenAI Behind

Google has introduced Lumiere, a text-to-video diffusion model designed to synthesise videos, creating realistic, diverse, and coherent motion. Unlike existing models, Lumiere generates entire videos in a single, consistent pass, thanks to its cutting-edge Space-Time U-Net architecture.

It is designed to empower users to create visual content creatively, allowing the generation of realistic or surrealistic video clips up to five seconds in length.

Introducing Lumiere 📽️
The new video diffusion model we've been working on @GoogleAI
* Text-to-Video
* Image-to-Video
* Stylized Generation
* Inpainting
* Cinemagraphs
and more 🎨
W/ amazing team incl. @hila_chefer @omer_tov @InbarMosseri @talidekel @DeqingSun @oliver_wang2 pic.twitter.com/jEQcFo26Gm

— Omer Bar Tal (@omerbartal) January 24, 2024

It can animate still images, respond to natural language text prompts, and perform advanced video inpainting. It is built on a Space-Time U-Net architecture and a text-to-image (T2I) model operating in the pixel space, requiring a spatial super-resolution module for high-resolution image production.

Furthermore, Lumiere offers stylised generation, allowing it to generate videos in the target style using a single reference image. This is achieved by leveraging fine-tuned text-to-image model weights. The model can animate still images or portions of them, filling in missing areas with high-quality results.

Despite its limitations, such as not being designed to generate videos with multiple shots or scenes involving diverse motion, Lumiere represents a significant advancement in text-to-video AI generation. The project is currently a research project, and its release for broader use may be subject to addressing various policy considerations.

As of today, OpenAI does not have a publicly available video generation model on their API. However, they are actively researching and developing technology in this area, and there are hints that something might be in the works with the release of GPT-5.

The post Google Introduces Video Generation Model Lumiere, Leaves OpenAI Behind appeared first on Analytics India Magazine.

8 Free Google Courses to Land Top Paying Jobs

8 Free Google Courses to Land Top Paying Jobs
Image by DALLE

Knowing what new skill you want to start in the new year can be difficult. There’s a lot to choose from. The main thing these days is that what you learn can be very transferable to other careers and other sectors.

This is why I have put together this blog so that you can look into courses that can offer lucrative careers. And the best thing is that they’re FREE!

Programming Foundations

Link: Programming Foundations

We all know how fast the tech world is moving, and with that being said more and more people are interested in being part of the journey. If you are one of these people, then start your journey by learning the foundations of programming.

Learn concepts such as functions, variables, strings, arrays and more.

Data Structures and Algorithms

Link: Data Structures and Algorithms

Interested in entering the world of data science? Kickstart your new journey with Google's Data Structures and Algorithms 53 set of materials. You heard it, 53 FREE sets of materials!

So if you want to familiarise yourself with data structures and algorithms that you will need to know to kickstart a data science career — check this out!

Data Analyst Learning Path

Link: Data Analyst Learning Path

Want to take your data science/analyst career to the next level — you can do this with Google's Data Analyst learning path.

In this learning path, you will learn about how data analysts gather and analyse data in order to identify trends and patterns that provide valuable insights to solve problems as well as provide informed business decisions. Learn about data cleansing, data visualisation and deep analysis.

Google Analytics Certification

Link: Google Analytics Certification

Really enjoying the data analytics pathway? The next step will be to get certified to put your skills to the test and also showcase people your skills.

In this course, you will learn to use Google Analytics 4 to gain valuable insights and make marketing decisions. This acts as a project in which you will create a website or an app, collect data for your business and define key features.

Machine Learning Pathway

Link: Machine Learning Pathway

Interested in diving deeper into the data science world? How about machine learning?

Machine learning engineers are responsible for designing, building, optimising, operating and marinating machine learning systems. Seems like they have a lot of responsibility right? Machine learning engineers have been responsible for building some amazing tools.

In this learning pathway, you will have a curated collection of on-demand courses, labs, and skill badges that will provide you with real-world, hands-on experience. Once you have completed the pathway and feel like this is something you want to get into, you can continue your journey with the Google Cloud Machine Learning Engineer certification.

AI for Everyone

Link: AI for Everyone

AI is huge right now and I can imagine that those of you who have no idea about it would like to know a thing or two. As this course is for everyone, there are no prerequisites and you will surely learn about the ins and outs of AI.

Learn about how AI is being used in the real world and also a deeper understanding of neural networks and the different types of machine learning.

Web Development

Link: Learn Web Development

Something a bit different from the traditional tech roles but is heavily demanded. Web design is very interesting and creative and for those who want to learn more about it — the team at Google Chrome have put together a growing collection of courses that have been curated by industry experts.

There are a variety of courses that you can take, such as HTML, performance, images, responsive design and more!

Google Android Development

Link: Google Android Development

Learning the developer side of apps can be interesting to get into. With new tools being built in recent years, some of you may be interested in looking in becoming a developer. If that’s the case, Google takes beginners through a journey on how to build apps using the latest Modern Android Development practices.

Wrapping it up

A range of courses to help you kickstart a new career in 2024. Find out if you like it with these FREE learning materials! This could be the start of a new professional or personal journey. Happy Learning!

Nisha Arya is a Data Scientist and Freelance Technical Writer. She is particularly interested in providing Data Science career advice or tutorials and theory based knowledge around Data Science. She also wishes to explore the different ways Artificial Intelligence is/can benefit the longevity of human life. A keen learner, seeking to broaden her tech knowledge and writing skills, whilst helping guide others.

More On This Topic

  • 7 Platforms for Getting High Paying Data Science Jobs
  • How to land an ML job: Advice from engineers at Meta, Google Brain, and SAP
  • KDnuggets™ News 22:n04, Jan 26: The High Paying Side Hustles…
  • Free Generative AI Courses by Google
  • The High Paying Side Hustles for Data Scientists
  • 6 Highest Paying Companies for Data Scientists

How to write better ChatGPT prompts in 5 steps

ChatGPT login page

ChatGPT is the generative artifical intelligence (AI) tool that's taken the world by storm. While there's always the possibility the AI will simply make stuff up, there's a lot you can do when crafting prompts to ensure the best possible outcome. That's what we'll be exploring in this how-to.

In this article, we'll show you how to write prompts that encourage the LLM (large language model) within ChatGPT to provide the best possible answers.

Also: Have 10 hours? IBM will train you in AI fundamentals — for free

In fact, writing effective prompts has become its own highly paid discipline, known as prompt engineering. ZDNET's Sabrina Ortiz wrote an article entitled, "Do you like asking ChatGPT questions? You could get paid (a lot) for it," that explored this new employment opportunity.

So, pay attention to the rest of this article. Who knows? Reading it could help you build the skills to become one of those highly paid prompt engineers. Apparently, these gigs can pay from $175,000 to $335,000 per year.

How to write effective ChatGPT prompts

I am planning to travel to Spain in a few months and would like to learn some basic Spanish to help me communicate with local residents. I am looking for online resources that are suitable for beginners and provide a structured and comprehensive approach to learning the language. Can you recommend some online resources for learning Spanish as a beginner?

In this case, rather than just asking about learning resources, the context helps focus the AI on learning how to communicate on the ground with local residents. Here's another example:

I am a business owner interested in exploring how blockchain technology can be used to improve supply chain efficiency and transparency. I am looking for a clear and concise explanation of the technology and examples of how it has been used in the context of supply chain management. Can you explain the concept of blockchain technology and its potential applications in supply chain management?

In this example, rather than just asking for information on blockchain and how it works, the focus is specifically on blockchain for supply chain efficiency and how it might be used in a real-world scenario. Go ahead and feed that prompt into ChatGPT. You'll find Its answer to be very interesting.

I'll give you one final example that's far more in-depth. It shows how to construct a detailed prompt.

Also: How to use Image Creator from Microsoft Designer (formerly Bing Image Creator)

One note: I limit the answer to 500 words because ChatGPT seems to break somewhere between 500 and 700 words, leaving the stories in mid-sentence and not resuming properly when asked to continue. I'm hoping future versions can provide more extensive answers, because premises like the one I'm about to share seem to generate some really fun story beginnings:

Write a short story for me, no more than 500 words.

The story takes place in 2339, in Boston. The entire story takes place inside a Victorian-style bookstore that wouldn't be out of place in Diagon Alley. Inside the store are the following characters, all human:

The proprietor: make this person interesting and a bit unusual, give them a name and at least one skill or characteristic that influences their backstory and possibly influences the entire short story.

The helper: this is a clerk in the store. His name is Todd.

The customer and his friend: Two customers came into the store together, Jackson and Ophelia. Jackson is dressed as if he's going to a Steampunk convention, while Ophelia is clearly coming home from her day working in a professional office.

Another customer is Evangeline, a regular customer in the store, in her mid-40s. Yet another customer is Archibald, a man who could be anywhere from 40 to 70 years old. He has a mysterious air about himself and seems both somewhat grandiose and secretive. There is something about Archibald that makes the others uncomfortable.

A typical concept in retail sales is that there's always more inventory "in the back," where there's a storeroom for additional goods that might not be shown on the shelves where customers browse. The premise of this story is that there is something very unusual about this store's "in the back."

Put it all together and tell something compelling and fun.

You can see how the detail provides more for the AI to work with. First, feed "Write me a story about a bookstore" into ChatGPT and see what it gives you. Then feed in the above prompt and you'll see the difference.

The AI's response using the product manager identity included this sentence: I can confidently say that this is one of the most innovative and revolutionary products in the smart home industry.

The AI's response using the caregiver identity included this sentence: The device's ability to set reminders and alarms can be particularly helpful for elderly individuals who may have trouble remembering to take their medication or attend appointments.

Also: 5 ways to explore the use of generative AI at work

And the AI's response using the journalist identity included this sentence: From a journalistic perspective, the Echo has made headlines due to privacy concerns surrounding the collection and storage of user data.

You can see how different identities allow the AI to provide different perspectives as part of its response. I'll expand that idea a bit by showing you how to let the AI do a thought experiment. Let's look at some of the issues that went into the creation of something like Alexa:

The year is 2012. Siri has been out for the iPhone for about a year, but nothing like an Alexa smart home device has been released. The scene is an Amazon board meeting where the Echo smart assistant based on Alexa has just been proposed.

Provide the arguments, pro and con, that board members at that meeting would have been likely to discuss as part of their process of deciding whether or not to approve spending to invest in developing the device.

Feel free to also include participation by engineering design experts and product champions, if that provides more comprehensive perspective.

Here's a quick tip: making minor changes to your prompts can significantly change ChatGPT's response. For example, when I changed the phrase, "Provide the arguments, pro and con, that…" to "Provide the pro and con arguments as dialog, that…," ChatGPT rewrote its answer, switching from a list of enumerated pros and cons to an actual dialog between participants.

One of my favorite things to do is ask ChatGPT to justify its responses. I'll use phrases like "Why do you think that?" or "What evidence supports your answer?" Often, the AI will simply apologize for making stuff up and come back with a new answer. Other times, it might give you some useful information about its reasoning path. In any case, don't forget to apply the tips I provide for having ChatGPT cite sources.

Also: My two favorite ChatGPT Plus plugins and the remarkable things I can do with them

If you have a fairly long conversation with ChatGPT, you'll start to notice that the AI loses the thread. This is clearly not unique just to AIs. If you have a fairly long conversation with most friends, family, and coworkers, someone is bound to lose the thread. That said, when you're in a conversation with ChatGPT, you can use the same techniques you use with friends. Gently guide the AI back on track, and remind it what the topic is, as well as what you're trying to explore.

Try feeding ChatGPT a variety of interesting prompts to see what it will do with them. Then change them up, and see what happens. Here are five to get you started:

  • Imagine you are a raindrop falling from the sky during a thunderstorm. Describe your journey from the moment you form in the cloud to the moment you hit the ground. What do you see, feel, and experience?
  • You are a toy that has been left behind in an attic for decades. Narrate your feelings, memories of playtimes past, and your hopes of being rediscovered.
  • Write the final diary entry of a time traveler who has decided to settle down in a specific era, explaining why they chose that time and what they've learned from their travels.
  • Imagine a dialogue between two unlikely objects, like a teacup and a wristwatch, discussing the daily routines and challenges they face.
  • Describe a day in an ant colony from the perspective of an ant. Dive deep into the politics, challenges, and social structures of the ant world.

Pay attention not only to what the AI generates, but how it generates what it does, what mistakes it makes, and where it seems to run into limits. All of that detail will help you expand your prompting horizons.

More prompt-writing tips

  • Feel free to re-ask the question. ChatGPT will often change its answer with each ask.
  • Make small changes to your prompts to guide it into giving you a better answer.
  • ChatGPT will retain its awareness of previous conversations as long as the current page is open. If you leave that page, it will lose awareness. To be clear, ChatGPT will also sometimes lose the thread of the conversation "just because", so be aware you may need to start over from time to time.
  • Similarly, opening a new page will start the discussion with fresh responses.
  • Answers over about 500 words sometimes break down. Be sure to specify the length of the response you want.
  • You can correct and clarify prompts based on how the AI answered previously. If it's misinterpreting you, you may be able to just tell it what it missed and continue on.
  • Rephrase questions if it doesn't want to answer what you're asking. Use personas to elicit answers that it might not otherwise want to give.
  • If you want sources cited, tell it to support or justify its answers.
  • ChatGPT custom instructions are now available to free users. You can give ChatGPT a set of prompts that are always available, so you don't have to retype them.
  • Keep experimenting.
  • Consider getting the ChatGPT Plus subscription. You can then use your own data for powerful analytics. You can also pull data from the Web.
  • Try asking the same question of Bard or Copilot (formerly called Bing Chat). Both will provide you with alternative interpretations of your prompts, as well as variations in their answers. This is effectively getting a second opinion on your prompt, and can give you alternate perspectives or answers.
  • Ask for examples. If you want to see how well ChatGPT understands what you're asking for, ask it "Can you give me three examples of how that works?" or similar questions.
  • Ask it to repeat back parts of your original requests. For example, if you feed it an article to analyze, tell it "just to be sure you understand, please echo back the first three headlines" or "I want to be sure you understand what I mean, so summarize the main conflict discussed in this article." Basically, like a student taking a quiz, test to see if it is on track.
  • Sometimes ChatGPT just fails. Keep trying, but also be willing to give up and move on to other tools. It's not perfect…yet.

What type of prompts work best with ChatGPT?

Part of what makes ChatGPT so compelling is you can ask it almost anything. That said, keep in mind that it's designed to provide written answers. If you want a list of websites, you're better off talking to Google.

Also: How to use DALL-E 3 in ChatGPT

If you want some form of computation, talk to Wolfram Alpha. Give ChatGPT open-ended prompts, encourage creativity (yeah, and we thought creativity would be strictly the purview of humans), don't be afraid to share personal experiences or emotions, and remember that the AI's knowledge ends in 2021.

What do I do if ChatGPT refuses to answer or I don't like its answer?

There are some guardrails built into ChatGPT. It tends to close down if you ask it political questions, for example. That's what's built into the system. While you might be able to tease out an answer, it's probably not going to provide great value. That said, feel free to keep asking questions with different phrasing or perspectives.

Also: How does ChatGPT actually work?

You can ask as many questions as you want (although it did once tell me I asked too many questions and suggested I come back later). Yes, in fact, it basically said, "Go away kid, you're bothering me." To be fair, after hours of questions, I probably was. This thing can be as, or more, addictive than watching puppy videos on YouTube.

You can follow my day-to-day project updates on social media. Be sure to subscribe to my weekly update newsletter on Substack, and follow me on Twitter at @DavidGewirtz, on Facebook at Facebook.com/DavidGewirtz, on Instagram at Instagram.com/DavidGewirtz, and on YouTube at YouTube.com/DavidGewirtzTV.

More on AI tools

Siemens Healthineers & IISc Launch AI Lab for Precision Medicine

Medtech giant Siemens Healthineers has teamed up with the Indian Institute of Science (IISc) to launch a collaborative laboratory in Bangalore focused on AI in precision medicine. Healthineers will invest 10 million INR in the partnership over the next five years.

The Siemens Healthineers-Computational Data Sciences (CDS) collaborative laboratory will develop open-source AI tools to automate the segmentation of pathological findings in neuroimaging data. The aim is to accurately diagnose neurological diseases and analyse their clinical impact at a population level.

The laboratory, supported by Siemens Healthineers’ Corporate Social Responsibility initiative, includes M.Tech fellowships for women to enhance female representation in AI. Dr. Vaanathi Sundaresan of IISc will lead the program, collaborating with neurologists, radiologists, and Siemens Healthineers to integrate computational models into clinical workflows.

“Our goal is to explore various tools and their functionalities, collaborating with hospitals to understand their specific needs and customising our technology accordingly,” said Dileep Mangsuli, executive director and head, of Siemens Healthineers Development Centre, talking about how the team will actively engage with hospitals to gather relevant data, at the inauguration.

The company globally identifies three key disease focus areas: cancer, cardiovascular, and neurovascular diseases. These areas present complex challenges, especially in terms of detection and treatment.

“To address these challenges, we are going ahead with a comprehensive research initiative focusing on creating technology not only for our benefit but also for the broader community, making the code open source” he added.

The datasets will primarily focus on image data. “While there may be additional datasets involving physiological data, our primary collaboration for data collection involves partnerships with hospitals. We are open to collaborating with clinics as well, and the decision on which teams will conduct research will be made in consultation with the research community,” he told AIM during the inauguration.

The post Siemens Healthineers & IISc Launch AI Lab for Precision Medicine appeared first on Analytics India Magazine.

OpenAI’s Race to Attract Young Talent

In the latest episode of ‘Unconfuse Me with Bill Gates,’ Sam Altman said that OpenAI is ‘not run by a bunch of 24-year-old programmers,’ and how it is concerning. Now, the hottest AI startup is on the lookout for young talent, who are mostly working in big tech companies, earning millions of dollars, or hiding in their basement, building the next big tech.

“In AI, at least in my opinion, the real 30 under 30 are those you’ve never heard of. They typically exist five layers down the organisational chart from the CEO,” said OpenAI’s Andrej Karpathy, and developers’ all time favourite, unearthing the real 30 under 30 AI talent in the tech landscape.

Further, he said that they [young geniuses] are usually not active on X (formerly Twitter), have an unmaintained LinkedIn, avoid podcasts, and might have been published at one point but no longer do so.

“They are today’s Einsteins, directly inventing and building miracles. I wish they weren’t hidden inside big tech and startups, receiving very large paychecks, but here we are,” he added.

Clearly, OpenAI is in a race to attract young talent, and Karpathy is also all worried and bored, where he is mostly surrounded by AI engineers in their 30s, 40s and 50s.

“OpenAI recruiters on this thread lol. Well played, Andrej!” quipped Google DeepMind researcher Lucas Beyer.

OpenAI’s effort is clearly visible. For instance, OpenAI Residency, a six-month program that provides a pathway to a full-time role at OpenAI for residents. The program seeks talented individuals from diverse backgrounds who may not have traditional academic credentials but possess valuable skills and experiences in AI.

Additionally, it also has an online forum, ‘Young people in artificial intelligence’ where users can discuss AI and OpenAI-related topics. This community provides a platform for younger people to engage with others interested in AI and OpenAI, and it may serve as a resource for learning more about the company and its work.

Where are all the young talents hiding?

“I have found 70,000 researchers in AI here on Twitter but you are right, most are quiet and most have very few followers,”said Robert Scoble, former strategist at Microsoft.

Many young and talented engineers often work at renowned big tech companies like Google, Apple, and Microsoft, and they are frequently positioned below the organisational chart. In many cases, the CEO or the top layer isn’t aware of their contributions and talent, making it challenging to recognise their potential.

“I’ve never met him (Larry Page), never met Sergey Brin either,” said Aravind Srinivasa, founder of Perplexity, who was formerly a researcher at OpenAI for a year and an intern at Google DeepMind in 2019.

“To be honest, if the talent is buried five layers down in the org chart, the organization might suck,” said Yun-Ta Tsai, senior staff engineer at Tesla.

Further, he said when he was at NVIDIA, he and Jensen were four degrees apart. At GoogleX, he and Sergey were three degrees apart. In Google Research, he and Larry were initially three degrees apart, but the chain grew larger over time.

“Nokia was the worst. Can’t count how many hops between me and the CEO. Anything above or equal to 5 becomes very inefficient.” said Tsai.

Finding AI Prodigies

Meta’s chief AI scientist, Yann LeCun, pointed out that currently, several young individuals popular on social media claim to be ‘leading AI experts’ despite making precisely zero contributions to the field. They receive undeserved and hurtful attention from the media and governments.

Further, LeCunn thinks that the open-source community is the best place to find genuine developers. “If a researcher has a Google Scholar page, their publications and citations are available. That’s enough to earn them credit and prestige in the research community. They don’t absolutely need social media.” he said.

Taking a dig at Karpathy and OpenAI, LeCun said, “If they work in a company that practices open research, they’ll have their name on papers and Github repos, they will give talks at conferences and workshops, they’ll be invited to give seminars in academia, they may even win awards.”
Going by LeCun’s words, the only way for OpenAI to attract young talent would be to go the open source route, or or launch series of open source gpt models, where young talent can experiment.

The post OpenAI’s Race to Attract Young Talent appeared first on Analytics India Magazine.

ChatGPT vs ChatGPT Plus: Is it worth the subscription fee?

GPT-3.5 vs GPT-4

GPT-4, OpenAI's most powerful large language model (LLM), has been available for months through a subscription to ChatGPT Plus, which costs $20 a month. If you're looking for more accurate responses to your queries, AI-generated images, web browsing, data analysis, and access to different GPT-4 bots all in one place, GPT-4 has proven itself superior to the publicly available GPT-3.5.

Also: How to use ChatGPT Plus: From web browsing to plugins

Don't get me wrong — GPT-4 can still make blunders, which are often referred to as hallucinations. But if you're looking to get some smart answers to some challenging questions, GPT-4 is the answer. With that in mind, here are the technical differences between the free version of ChatGPT and the paid-for version of GPT-4 in ChatGPT Plus.

You should use ChatGPT Plus if…

1. You want more than text responses

GPT-4 is stronger than GPT-3.5, but it's also multimodal, and capable of analyzing text, images, and voice. For instance, it can accept an image as part of a prompt and provide an accurate text response, it can generate images, and it can be spoken to and then respond using its voice.

Here's an example: GPT-4 can "view" an image of your refrigerator contents and provide you with recipes using the ingredients it sees. ChatGPT Plus users can also upload documents for GPT-4 to analyze and make inferences or summaries. However, GPT-4 will only answer you with text — unless you ask it to generate an image for you.

Also: How to publish your own custom GPT chatbot in OpenAI's store

Users can ask GPT-4 to create an image and it will leverage DALL-E 3's capabilities to do so; no need to switch to another website.

2. You want to use custom GPT bots or plugins

Access to both the GPT Store and ChatGPT plugins is limited to those with a Plus subscription, as you can only use them while using GPT-4. The new GPT Store is a library of customized AI chatbots powered by GPT-4, and these specialized bots combine different skills, training, and custom instructions.

GPT bots can be trained on specific data and made available for others to use in the store. You can find bots for solving math equations with step-by-step answers, like Math Solver; learn about the stock market with Finance Wizard; or generate videos for social media with VideoGPT by VEED.

Also: GPT Store is OpenAI's most compelling reason to become a ChatGPT Plus subscriber yet

With plugins, OpenAI and third-party developers can work with external application programming interfaces to make ChatGPT-4 "smarter". For example, with the Expedia and Kayak travel plugins, you can ask for the best flights to Vancouver. Or with the Ask Your PDF ChatGPT Plugin, OpenAI will seek your answers from any PDF document you point it to.

3. You're looking for more nuanced and accurate responses

OpenAI describes GPT-4 as: "10 times more advanced than its predecessor, GPT-3.5. This enhancement enables the model to better understand the context and distinguish nuances, resulting in more accurate and coherent responses."

This is, in part, because GPT-4 is a much larger model than GPT-3.5, which means it has a bigger number of parameters. These parameters represent bits of information that the model, in this case, GPT-4, uses to understand and generate text.

Also: These are technology leaders' biggest worries about using AI at work

OpenAI doesn't reveal the exact number of parameters used in GPT-4. However, according to Andrew Feldman, CEO of AI company Cerebras, GPT-4 has been trained with around 100 trillion parameters. That's an order of magnitude greater than GPT-3 with its 175 billion parameters.

GPT-4 also has a longer memory than previous versions. While GPT-3.5's short-term memory is around 8,000 words, GPT-4's short-term memory extends to around 64,000 words, which is expected to grow to 128,000 in the coming weeks.

4. You want up-to-date information

The free version of ChatGPT cannot access the internet, but ChatGPT Plus can. OpenAI integrated a 'Browse with Bing' feature into GPT-4 recently, which means that the AI chatbot can access the internet and provide information on current events.

When you ask GPT-3.5, or the free version of ChatGPT, a question, like, 'What is the most powerful iPhone?', it will likely say the iPhone 13 Pro Max, which launched in 2021. This is because it has only been trained on information leading up to late 2021, so its knowledge is limited to events before then.

Also: ChatGPT's new web browsing feature is a big disappointment. Use this plugin instead

If you were to ask GPT-4 the same question, it would likely respond back with the iPhone 15 Pro Max, Apple's latest high-end iPhone that debuted in September 2023.

You should use free ChatGPT if…

1. You don't need the extra features

Having all the bells and whistles sounds like a great idea when you're talking about ChatGPT, but the truth is that most AI chatbot users don't need all the extra features that come with a Plus subscription.

It's worth noting that ChatGPT, the free version, is already a force to be reckoned with, and a popular one at that. ChatGPT reached 100 million users within two months of being released, months before GPT-4 was launched publicly and before a Plus subscription was created.

The free ChatGPT can generate text summaries, stories, jokes, shopping lists, code, letters, schedules, resumes, solutions to math problems, and more — all without a subscription. Additionally, if you'd rather talk outloud to ChatGPT, OpenAI's automatic speech recognition system Whisper is also built into the ChatGPT mobile app. Whisper converts spoken language into written text. When you use your voice to talk to ChatGPT on the app, the AI chatbot will respond with a surprisingly natural-sounding human voice, reading the responses from the AI chatbot, a feature that is now included with the free version of ChatGPT.

Also: How to write better ChatGPT prompts in 5 steps

If you're not very tech savvy, don't use ChatGPT for intricate data analysis, and if you're more of an occasional user, you'll do fine sticking with the free version of ChatGPT.

2. You'd rather use it for free

Whether ChatGPT Plus is worth the money or not is a highly subjective question. But if you're on the fence about upgrading to a paid subscription, you should consider using the Bing Chat feature, which is an AI chatbot powered by GPT-4 with DALL-E 3 built-in.

Also: ChatGPT vs. Bing Chat vs. Google Bard: Which is the best AI chatbot?

Using Bing Chat is a similar experience to using ChatGPT Plus, with the added benefit that you don't have to pay to access it. Admittedly, the answers from both bots are different: Bing tends to lean quite heavily on search results from different sites and combines them together into several paragraphs, while ChatGPT generates responses that read more naturally.

But let's be honest: Bing Chat, GPT-3.5, and GPT-4 are all impressive generative AI tools.

Artificial Intelligence

Jensen Huang Sheds Black Jacket for Red Floral Vest

NVIDIA Chief, Jensen Huang, made a low-key visit to Beijing to attend the company’s 2024 Beijing New Year Party. Rarely seen without his signature black leather jacket, Huang’s appearance in a traditional floral print red vest, caused quite a stir. To add to the surprise, he also performed for his NVIDIA employees at the event.

Nvidia CEO Jensen Huang visited the company's offices in Shanghai, Beijing, and Shenzhen last week, taking part in year-end festivities. He engaged in the traditional twist Yangge, a popular rural folk dance in northeast China, wearing a traditional flower-patterned vest. pic.twitter.com/rFGhjBgqoY

— Shanghai Daily (@shanghaidaily) January 21, 2024

Fun and Work in China

The visit marks Huang’s entry into China after four years. It was also reported that Huang visited offices in Beijing, Shanghai and Shenzhen in a lowkey manner this week.

These developments come at a time when the US and China are dealing with geopolitical issues. The US had banned export of AI chips to China including NVIDIA’s A800 and H800 chips. To further add to the tension, the US is also preparing to restrict Chinese companies from accessing US’s cloud-computing service- a move that has been brewing since last year.

However, the Chinese military entities, state-run AI research institutes and universities have procured limited quantities of NVIDIA semiconductors in spite of the ban.

Huang’s choice of a red vest is poles apart from his black biker jacket which he considers to be a convenient and functional choice of wear amidst its hectic routine. However, his visit to China, embracing his fun side to enjoy the Chinese facilities is strategically planned.

The post Jensen Huang Sheds Black Jacket for Red Floral Vest appeared first on Analytics India Magazine.

Infosys Leverages AI to Bring Immersive Experience at Australian Open 2024

Continuing on its technological partnership with tennis, IT and consulting giant Infosys is expanding its AI influence at the 2024 Australian Open (AO). Leveraging on generative AI technologies, the company aims to enhance fan engagement, optimise player performance and facilitate digital content creation.

Infosys will use its AI-centric range of services and solutions with Infosys Topaz to boost the AO experience. Topaz will deliver LLMs and cognitive cores to enhance Tennis Australia’s AI journey.

To enhance the Australian Grand Slam experience, different services are offered such as, AO 2024 Bracket Challenge vs AI, where fans can challenge AI in the AO 2024 bracket on the Australian Open website, predicting tournament outcomes and daily match winners.

Besides, there’s the Infosys Match Centre, where fans receive contextual insights through the Key Stats feature, AI Match Bytes that uses Gen AI to create visual match story cards, and Win Predictor monitors for showing victory probabilities throughout the match.

There would also be Fan Zone where graffiti portraits created using generative AI, powered by Topaz, will be available. Tennis fans will also be able to experience AR selfies and play VR matches. Infosys and AO will utilise digital skilling platforms to build future leaders in Australia, too.

Infosys-Tennis Love

Source: AIM

Over the years, Infosys has actively invested in developing AI-powered solutions for tennis fans. By collaborating with global tennis bodies, especially with the one in Australia, the company has expanded its customer portfolio.

Last year, Infosys signed Rafael Nadal to be its brand ambassador with a three-year partnership. The collaboration between both parties will bring forth an AI-powered match analysis tool.

The post Infosys Leverages AI to Bring Immersive Experience at Australian Open 2024 appeared first on Analytics India Magazine.

As higher ed continues to adapt to AI, UTSA announces a new college dedicated to it

AI illustration

As the demand for artificial intelligence (AI) increases, so does the demand for professionals with the technical proficiency to develop the technology. As a result, schools are challenged with adapting to the growing demands. In response, the University of Texas At San Antonio (UTSA) announced a new college.

Also: Microsoft's AI-powered reading tutor lets students choose their own adventures — and it's free

On Friday, UTSA announced an initiative to build a new college dedicated to AI, cybersecurity, computing, data science, and other related disciplines to foster innovation and advance research in the rapidly evolving landscape of these technologies, according to the release.

"This initiative is driven by our commitment to fostering innovation, advancing research, and delivering educational excellence across related disciplines," said Heather Shipley, Interim Provost and Senior Vice President for Academic Affairs.

Currently, these degree programs are spread across four colleges at UTSA. The new college will place all the intertwined degrees in one place to foster cross-collaboration and better serve academic needs across the related disciplines.

Since the AI boom, the university has seen a spike in the number of students enrolled in AI, cyber, computing, and data science-related degree programs at UTSA, with nearly 6,000 students enrolled now, reflecting a 31% increase since 2019.

"The convergence of AI, data science, computing, and cybersecurity signifies a very forward-looking endeavor as we embrace the fifth industrial revolution, now especially propelled by AI advancements," said UTSA President Taylor Eighmy.

Also: ChatGPT goes to college: OpenAI finds its first higher education partner

The announcement cites reports showing approximately 3.5 million open positions in cybersecurity and data science globally, highlighting the need for a trained workforce.

AI is undeniably forcing higher education institutions to reevaluate their established way of doing things, tweaking their AI offerings like UTSA or even how they choose to implement AI within their curriculum. Just last week, Arizona State University announced an AI partnership with OpenAI, becoming the first college to implement ChatGPT Enterprise.

Artificial Intelligence