Attention ISN'T all you need?! New Qwen3 variant Brumby-14B-Base leverages Power Retention technique

VentureBeatTuesday, November 4, 2025 at 7:37:00 PM
PositiveTechnology
Attention ISN'T all you need?! New Qwen3 variant Brumby-14B-Base leverages Power Retention technique
The introduction of the transformer architecture in 2017 revolutionized artificial intelligence, becoming a foundation for major language models like OpenAI's GPT and Google's Gemini. The new Qwen3 variant, Brumby-14B-Base, utilizes a Power Retention technique, suggesting that attention may not be the only key to success in AI.
— Curated by the World Pulse Now AI Editorial System

Was this article worth reading? Share it

Recommended Readings
Chrome can now store your driver's license and passport, but is that safe?
PositiveTechnology
Google's Chrome browser has introduced a feature that allows users to store their driver's licenses and passports, making autofill even more convenient. While this can save time, it's important to be aware of potential security risks and learn how to enable this feature safely.
OpenAI's Sora app is now available on Android
PositiveTechnology
OpenAI has launched its Sora app on Android, making it accessible to a wider audience. This new release is expected to enhance user experience and provide more opportunities for engagement with AI technology.
Nothing has a fix for its Meta bloatware issue, solving a problem that never should’ve existed
NegativeTechnology
The article discusses the ongoing problems with Meta's bloatware, questioning why such issues exist in the first place. It highlights the frustration users feel over software that should be efficient but instead causes unnecessary complications. This matters because it reflects broader concerns about software quality and user experience in an increasingly digital world.
Microsoft warns a key OpenAI API is being exploited to launch cyberattacks
NegativeTechnology
Microsoft has raised alarms about the exploitation of OpenAI's Assistants API, which is being used as a command and control server for cyberattacks. This is concerning because it highlights the vulnerabilities in AI technologies that can be manipulated for malicious purposes, posing risks to businesses and individuals alike.
Missed a crucial Google Meet call? You can now catch up easily in Chat
PositiveTechnology
Google is enhancing its Meet platform by integrating it more closely with Chat, allowing users to easily catch up on missed calls through shared content and emoji reactions. This update is significant as it streamlines communication and collaboration, making it easier for teams to stay connected and engaged, even if they miss a live meeting.
Meta finally made a proper WhatsApp app for Apple Watch
PositiveTechnology
Meta has launched a dedicated WhatsApp app for Apple Watch, enhancing user experience by allowing seamless messaging directly from the wrist. This development is significant as it caters to the growing demand for mobile communication on wearable devices, making it easier for users to stay connected without needing to reach for their phones.
OpenAI bets $38B on Amazon's cloud to power ChatGPT and the future of AGI
PositiveTechnology
OpenAI's recent $38 billion investment in Amazon's cloud services marks a significant milestone for both companies. This partnership not only strengthens Amazon's position in the rapidly growing AI cloud market but also enhances OpenAI's capabilities in developing advanced AI technologies like ChatGPT. As the competition in artificial intelligence heats up, this collaboration could lead to groundbreaking innovations that benefit various industries and consumers alike.
Google and Disney’s YouTube TV war is escalating – Disney is pulling its movies, and coverage of key US elections is affected
NegativeTechnology
The ongoing conflict between Google and Disney has taken a significant turn as Disney removes its movies from Google TV, YouTube, and the Play Store. This move not only affects viewers who rely on these platforms for Disney content but also raises concerns about the availability of coverage for key US elections. The implications of this dispute could reshape how audiences access entertainment and information, making it a critical issue for both companies and their users.
Latest from Technology
Databricks research reveals that building better AI judges isn't just a technical concern, it's a people problem
PositiveTechnology
Databricks' latest research highlights that the challenge in deploying AI isn't just technical; it's about how we define and measure quality. AI judges, which score outputs from other AI systems, are becoming crucial in this process. The Judge Builder framework by Databricks is leading the way in creating these judges, emphasizing the importance of human factors in AI evaluation.
Legendary CD-ROM maker has best value SSD pre-Black Friday: RiDATA 2TB Gen4 SSD costs only $106 and, surprise, surprise, has SLC cache
PositiveTechnology
The RiDATA A801 2TB NVMe SSD is making waves ahead of Black Friday with its impressive price of just $106. This drive not only offers incredible speeds of up to 5000 MB/s but also outperforms many more expensive models, making it a fantastic deal for tech enthusiasts.
Chrome can now store your driver's license and passport, but is that safe?
PositiveTechnology
Google's Chrome browser has introduced a feature that allows users to store their driver's licenses and passports, making autofill even more convenient. While this can save time, it's important to be aware of potential security risks and learn how to enable this feature safely.
Sequoia Capital Leader Exits in VC Shake-Up
NeutralTechnology
Roelof Botha, the managing partner of Sequoia Capital, has announced his departure from the firm after a challenging period. His exit marks a significant change in leadership for the investment company.
Attention ISN'T all you need?! New Qwen3 variant Brumby-14B-Base leverages Power Retention technique
PositiveTechnology
The introduction of the transformer architecture in 2017 revolutionized artificial intelligence, becoming a foundation for major language models like OpenAI's GPT and Google's Gemini. The new Qwen3 variant, Brumby-14B-Base, utilizes a Power Retention technique, suggesting that attention may not be the only key to success in AI.
Opinion | AI and the Coming White-Collar Political Upheaval
NeutralTechnology
The article discusses how the loss of manufacturing jobs in the 2000s had a significant impact on politics, suggesting that similar disruptions to white-collar jobs due to AI advancements will also influence political landscapes.