Bing Chat Enterprise: Microsoft's AI-Powered Communication Platform

11 Mar 2024 · 9 min

Ask about this episode

Ask anything about it. ChatGPT or Claude reads this page and answers with the times it was said.

Connect VO and ask about every podcast you hear, including the moments you saved. Add to ChatGPT · Add to Claude

In short

AI Today Podcast Episode Summary

Episode Title

Bing Chat Enterprise: Microsoft's AI-Powered Communication Platform

Overview In this episode of *AI Today*, the hosts discuss Microsoft's new Bing Chat Enterprise, an AI-driven communication tool aimed at enhancing workplace collaboration. The episode delves into how this platform may transform business operations and the implications for data privacy and security.

Key Highlights

  • Launch Announcement
  • Microsoft's Bing Chat Enterprise was unveiled at the annual Inspire conference.
  • The platform is positioned as a business-centric chatbot, integrating advanced AI capabilities.
  • Data Privacy and Security
  • A major concern among corporations is the potential privacy leaks when using AI chatbots.
  • Microsoft's Azure platform allows for hosting AI models like ChatGPT within a secure environment, ensuring data confidentiality.
  • Frank X. Shaw, Microsoft’s Chief Communications Officer, emphasizes that data inputted into Bing Chat Enterprise remains secure and is not used for retraining or other unintended purposes.
  • Corporate Adoption of AI Tools
  • There is a growing interest among businesses to leverage AI tools, but data privacy concerns have previously hindered adoption.
  • A survey revealed that 6.5% of employees have shared company data with AI chatbots, which led to tighter controls by companies.

Functionality of Bing Chat Enterprise

  • Enhanced Features
  • Bing Chat Enterprise offers functionalities including text, graph, and chart responses, as well as the capability to generate marketing content while maintaining data security.
  • A forthcoming visual search feature will allow users to upload images, which Bing can interpret and respond to with relevant information.
  • Integration and Accessibility
  • The tool will be available wherever Bing Chat is supported, including integration with the Edge browser and Windows Copilot on new devices.
  • Subscriptions for Bing Chat Enterprise will be included for Microsoft 365 E3, E5, Business Standard, and Business Premium customers, with a standalone offering priced at $5 per user monthly.

Economic Implications

  • Investment in AI Infrastructure
  • Financial analysts estimate that Microsoft's Bing Chat powered by OpenAI’s GPT-4 model may require a $4 billion infrastructure investment to effectively manage user queries.
  • Microsoft’s previous investments in AI and chatbot technologies indicate a significant financial commitment, with costs potentially reaching tens of millions monthly for operational expenses.

Conclusion The introduction of Bing Chat Enterprise signals a significant shift in how businesses may utilize AI tools for communication and collaboration. By addressing data privacy concerns, Microsoft is poised to foster greater enterprise engagement with AI chatbots, potentially reshaping the industry landscape.

---

Additional Resources

  • [Invest in AI Box](https://republic.com/ai-box)
  • [AI Box Waitlist](https://AIBox.ai/)
  • [AI Facebook Community](https://www.facebook.com/groups/739308654562189)
  • [AI in Music](https://musicalai.pro/)
  • [AI Models](https://aimodelspro.com/)

---

Privacy Policy For details on data privacy practices, visit [Privacy Policy](https://art19.com/privacy) and [California Privacy Notice](https://art19.com/privacy#do-not-sell-my-info).

Written by AI. May contain mistakes. Listen to the episode to check what was said.

Hear the part that matters, and keep it.Open this episode in VO. Double tap your headphones to save a moment as you listen.
Get VO free

Transcript

Automatic transcript. May contain errors.

0:00What can 160 years of experience teach you about the future? When it comes to protecting what matters, Pacific Life provides life insurance, retirement income, and employee benefits for people and businesses building a more confident tomorrow. Strategies rooted in strength and backed by experience. Ask a financial professional how Pacific Life can help you today. Pacific Life Insurance Company, Omaha, Nebraska, and in New York. Pacific Life and Annuity, Phoenix, Arizona. The wait is over. Dive into Audible's most anticipated collection. The Best of 2025, featuring top audiobooks, podcasts, and originals across all genres.

0:41Our editors have carefully curated this year's must-listens, from brilliant hidden gems to the buzziest new releases. Every title in this collection has earned its spot. This is your go-to for the absolute best in 2025 audio entertainment. Whether you love thrillers, romance or nonfiction, your next favorite listen awaits. Discover why there's more to imagine when you listen at audible.com slash best of the year. Microsoft has a big announcement that many believe is set to launch the Bing chat into the, I don't know, into this atmosphere. It's going to essentially be a really big move for Bing chat as they are now integrating this into enterprise or making a very big enterprise play.

1:25So today on the podcast, we're going to be diving into what exactly Microsoft is doing, what their plans are with this Bing chat, and how we think this is going to impact AI in enterprise. So the big story here is that Bing's essentially making what's called Bing chat enterprise, and they took the wraps off of their business-centric chatbot at this annual Inspire conference they recently did. You know, it's the same conference that they announced they would be having Meta's new Llama 2 model on Microsoft Azure as the preferred kind of cloud platform. But in any case, they made a bunch of big announcements there.

1:59And this is one of them. So they've actually drawn a lot of attention to the solutions, robust data, privatey and governance controls. What a lot of people I've heard of like about Microsoft and their Azure play is that, you know, a lot of people have been selling their core, everyone inside of their company, their organizations don't put private data, don't put company data into these AI chat bots, chat, GBT, et cetera, et cetera. Because the problem is there's privacy leaks, you know, There's people that are reviewing the responses on OpenAI's end that could be seeing this confidential data.

2:31So all sorts of, you know, abilities for private data to be leaked through these AI models. And so I think something that a lot of people really like about Microsoft Solution is that on the Azure platform, you have the ability to have hosted locally, you know, on your own server, hosted AI models like ChatGPT, including ChatGPT. That was actually one of the special rules, one of the special deals that Microsoft got was that when they made this massive investment into OpenAI, they were able to host ChatGPT on its own instance on the Microsoft Azure platform for organizations, enterprise companies to be able to use.

3:09And so that is completely safe because it's on its own service. It's on its own server. And so, you know, companies can be assured that their data isn't going to get leaked if they have one of these kind of specific setup servers with their own instance of chat GPT on it. So in addition to this, I think corporate customers have really signaled a keen interest in leveraging AI tools. That much is obvious. The entire, you know, the entire corporate industry, the entire corporate space is very, very interested in this. But of course, with all the data privacy concerns, that I think is one of the biggest reasons that have held many corporations back.

3:45So I think Microsoft's chief communications officer, that's Frank X. Shaw, he has really been a big advocate of this. And I think with Bing Chat Enterprise, he assured the data put into these AI models, especially on the Bing Chat Enterprise model, stays in the model. It stays safe, granting enterprises secure access to optimized answers, heightened deficiencies, and fresh avenues for innovation, right? That's what they're saying. But really what's happening is with this new Bing Chat Enterprise tool, companies are able to get, you know, more than just ChatGPT, especially because ChatGPT took away the public browsing capabilities.

4:25So they're able to get Bing, Bing Chat, which has got the internet on it, and it's got, you know, ChatGPT built into it. And companies can rest assured that when they put something into this, when they put private data into this, it stays in the model. It doesn't go anywhere. It's never used to retrain or to, you know, make more data. It's not getting sucked into a database somewhere. This is all kept absolutely confidential. I think that's what people really want to hear. So I think this fear was initially realized when Apple clamped down on internal uses of tools like OpenAEA's ChatGPT and also GitHub's Copilot.

4:58And then we had people like Samsung, Verizon, Bank of America, Walmart, Chase Bank, and a bunch of others. so as with a like according to a cyberhaven survey an alarming 6.5 percent of employees have reportedly pasted company data into chat gpt and 3.1 percent have even copied sensitive data into chat gpt so obviously this is an issue i think that's what you know made these companies essentially make mandates that their employee employees could not use these kind of tools but apart from you know really tightened data controls I think Bing chat enterprise parallels Bing chats functionality so launching in preview mode it can respond to queries with text graph charts and images it can even generate messaging for a new product or make product comparisons using sensitive data such as product specs and pricing right so imagine Apple's going to be launching the new version of the iPhone and they need some sort of spec pricing overview or whatever for their website obviously Apple's a big enough company that you probably just hire a person to manually do this but you can think other companies let's say a smaller company with something that's sensitive data they don't want to release this they can now actually use chat GPT to generate this kind of content without worrying that this data that the information that the specs is going to get leaked or could be leaked you know it's not just necessarily everyone's worried that this definitely is going to get leaked.

6:22This information definitely is going to get out there, but it's kind of just a worry that like it's possible like this might get leaked. This might go out there. So the soon to be unveiled visual search feature is also going to take Bing Chat Enterprise to the next level. We've seen something very similar yesterday out of Google Bard where essentially you're able to upload images into this thing and it's able to use images for search or images as inputs. So you could in essentially with the Google Bard one, it was really impressive. They had someone take a screenshot of an app on their phone throw it in there and say give me the code to generate this app and it was able to do that with like a timer app that they screenshotted so very very impressive it's going to be impressive if Bing Enterprise gets this this is something that we know GPT-4 has the capabilities of doing but sometimes they don't release all the capabilities of GPT-4 right away and honestly a lot of times Bing chat actually gets them ahead of chat GPT.

7:17So that may be the case here. And I think that that's really going to allow the AI to answer questions about uploaded images, find related content on the web. Visual search started rolling out today in Bing chat. I'm assuming they're doing this because, you know, Google Bar did it yesterday. So now all of a sudden they're like, boom, we can't be behind the ball. Let's launch it today. And that's going to be on mobile and also web platforms, which I think is going to be great. So Microsoft's consumer chief marketing officer, that's Yusuf Med, and also Jared Spataro, who is a CVP of modern work and business apps, really they detailed the workings of visual search in a blog post.

7:53But essentially, it just allows users to upload images and scour the web for related content. Bing then understands the image context, interprets it, and answers different questions about it. So Bing Chat Enterprise will be accessible whenever Bing chat wherever Bing chat is supported so you know bing.com slash chat I think is where most people get that Microsoft's edge browser has a little sidebar for it but soon it's also going to be with Windows copilot which is a brand new feature that is going to be brought to all new Windows devices so subscriptions are free for Microsoft 365 E3 E5 business standard business premium customers and also a standalone offering is going to be available for five dollars per user per month in the future.

8:37I think automatic activations of Bing chat enterprise is triggered once an employee logs into Bing using their organizational Microsoft account. So I think there's an increasing pressure to cash in on viral AI chatbot technologies like Bing chat, which reportedly cost open AI tens of millions in processing. I think someone calculated around$63 million just to train GPT-4. Now, of course, they have all the compute that has to run every single time you ask a question, it's costing them money. And so I think that that's what they, you know, they spent tens of millions of dollars in January alone.

9:11And then meanwhile, some people are saying that financial experts are predicting that Bing chat powered by OpenAI's chat GPT-4 model needs a massive 4 billion infrastructure investment to really cater to all Bing users' queries. So I I think that's going to be pretty massive, of course. And then I think the introduction of Bing Chat Enterprise is a follow-up to the recent unveiling of GitHub's Copilot for Business, Microsoft's$20 a month AI code implementation tool for the enterprise. In parallel, OpenAI launched ChatGPT +, which is a premium service, offering priority access to novel features and upgrades over the base level ChatGPT.

9:54If you don't have GPT Premium, like really you need it to get GPT-4, which is the best version of ChatGPT. So if you use chat GPT, highly recommend upgrading to GPT-4. I've had it for a number of months and it has definitely been a game changer as far as the quality of the results that come out of it. I think this is going to be really big. I'm excited to see what happens with Bing Chat Enterprise, how this pushes the industry forward essentially by allowing more companies and enterprises to engage with AI chatbots. I think this is going to be massive and I think this is going to be really big implications for the entire industry as more people essentially are onboarded and are going to be using these tools on a regular basis.

From the publisher

In this episode, we explore Microsoft's announcement of Bing Chat Enterprise, a groundbreaking AI-powered communication platform, discussing its potential impact on businesses and the future of workplace collaboration.

See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

More from AI Today

All 897 episodes
Bing Chat Enterprise: Microsoft's AI-Powered Communication PlatformAI Today · 9 min
Listen in VO