Evaluating LLMs for Zeolite Synthesis Event Extraction (ZSEE): A Systematic Analysis of Prompting Strategies

arXiv — cs.CLThursday, December 18, 2025 at 5:00:00 AM
  • A systematic analysis has been conducted to evaluate the efficacy of various prompting strategies for Large Language Models (LLMs) in extracting structured information from zeolite synthesis experimental procedures. This study focuses on four key subtasks: event type classification, trigger text identification, argument role extraction, and argument text extraction, utilizing a dataset of 1,530 annotated sentences.
  • The findings of this research are significant as they provide insights into the effectiveness of different prompting strategies, which can enhance the application of LLMs in materials discovery. By improving the extraction of scientific information, this work may accelerate advancements in the field of materials science.
  • This development reflects a growing trend in the application of LLMs across various domains, including time series forecasting and legal document interpretation. The ongoing exploration of different methodologies, such as the introduction of frameworks like STELLA and the Meta-Prompting Protocol, highlights the importance of optimizing LLM performance for specific tasks, addressing challenges in scientific discovery and beyond.
— via World Pulse Now AI Editorial System

Was this article worth reading? Share it

Recommended apps based on your readingExplore all apps
Continue Readings
Xiaomi Enters AI Race With Open-Source Model MiMo-V2-Flash
PositiveArtificial Intelligence
Xiaomi has entered the artificial intelligence sector with the launch of its open-source model, MiMo-V2-Flash, which reportedly matches the performance of established models from DeepSeek and Moonshot AI in reasoning benchmarks. This move marks a significant step for Xiaomi as it seeks to enhance its presence in the competitive AI landscape.
SynthSeg-Agents: Multi-Agent Synthetic Data Generation for Zero-Shot Weakly Supervised Semantic Segmentation
PositiveArtificial Intelligence
A novel framework named SynthSeg Agents has been introduced for Zero Shot Weakly Supervised Semantic Segmentation (ZSWSSS), which generates synthetic training data without relying on real images. This approach utilizes two key modules: a Self Refine Prompt Agent that creates diverse image prompts and an Image Generation Agent that produces images based on these prompts, enhancing the capabilities of semantic segmentation tasks.
Dual-Density Inference for Efficient Language Model Reasoning
PositiveArtificial Intelligence
A novel framework named Denser has been introduced to enhance the efficiency of Large Language Models (LLMs) by optimizing information density separately for reasoning and answering phases. This dual-density inference approach allows for the use of compressed, symbol-rich language during intermediate computations while ensuring that final outputs remain human-readable.
3DLLM-Mem: Long-Term Spatial-Temporal Memory for Embodied 3D Large Language Model
PositiveArtificial Intelligence
The introduction of 3DLLM-Mem marks a significant advancement in the capabilities of Large Language Models (LLMs) by integrating long-term spatial-temporal memory for enhanced reasoning in dynamic 3D environments. This model is evaluated using the 3DMem-Bench, which includes over 26,000 trajectories and 2,892 tasks designed to test memory utilization in complex scenarios.
Integrating Large Language Models and Knowledge Graphs to Capture Political Viewpoints in News Media
NeutralArtificial Intelligence
A new study has introduced an enhanced pipeline that integrates Large Language Models (LLMs) and Knowledge Graphs to analyze political viewpoints in news media. This approach utilizes a hybrid human-machine method to classify claims based on identified viewpoints, improving the understanding of media narratives. The research focuses on enriching claim representations with semantic descriptions from Wikidata.
Multiscale Aggregated Hierarchical Attention (MAHA): A Game Theoretic and Optimization Driven Approach to Efficient Contextual Modeling in Large Language Models
PositiveArtificial Intelligence
A novel architectural framework called Multiscale Aggregated Hierarchical Attention (MAHA) has been proposed to address the computational challenges of MultiHead SelfAttention in Large Language Models (LLMs). MAHA reformulates the attention mechanism through hierarchical decomposition and aggregation, allowing for dynamic partitioning of input sequences into hierarchical scales, which enhances the model's ability to capture global dependencies and multiscale semantic granularity.
MCP-SafetyBench: A Benchmark for Safety Evaluation of Large Language Models with Real-World MCP Servers
NeutralArtificial Intelligence
The introduction of MCP-SafetyBench marks a significant advancement in the safety evaluation of large language models (LLMs), utilizing real-world Model Context Protocol (MCP) servers to assess multi-turn interactions across various domains such as browser automation and financial analysis. This benchmark incorporates a comprehensive taxonomy of 20 attack types, addressing safety risks that traditional benchmarks overlook.
Towards Proactive Personalization through Profile Customization for Individual Users in Dialogues
PositiveArtificial Intelligence
The introduction of PersonalAgent marks a significant advancement in the deployment of Large Language Models (LLMs) for personalized user interactions. This user-centric lifelong agent is designed to continuously adapt to individual preferences, addressing the limitations of current alignment techniques that focus on static preferences and the cold-start problem.

Ready to build your own newsroom?

Subscribe to unlock a personalised feed, podcasts, newsletters, and notifications tailored to the topics you actually care about