AI Pipeline for Scientific Content
Abstract
This whitepaper presents a Hybrid Human-in-the-Loop Framework designed to distill complex scientific papers into engaging, accessible, and bilingual (IT/EN) outreach summaries, complete with high-definition neural voice synthesis.
The Human-in-the-Loop paradigm bridges two complementary strengths: Artificial Intelligence (automating semantic extraction, dual-language synthesis, multi-author ingestion, and quality scoring) and Human Editorial Governance (governing ethical open license verification CC BY 4.0, qualitative curation, and the final publishing decision).
Overcoming the pitfalls of fully autonomous generative pipelines β prone to hallucinations and licensing misclassifications β, the 3CN model demonstrates how procedural automation (.NET 10, Quartz, OpenRouter) empowers human discernment, delivering an ethical, high-integrity, and zero-tracking knowledge stream.
Chapter 1 β Introduction and context
This project was born from a moment of personal observation and frustration. During a mountain vacation, immersed in a landscape that invited calm and reflection, I found myself scrolling through news on my phone. The experience was disappointing: a monotonous sequence of crime news, gossip and political debates devoid of real informative content. Nothing that stimulated curiosity or conveyed a sense of discovery.
From this realization grew the idea of creating a news stream "as I like them": scientific, curious, positive content, written clearly and accessibly, capable of intriguing even young audiences. My goal was not just to inform, but to do so ethically, transparently and stimulatingly, leveraging the potential of Artificial Intelligence to automate what could be automated, without giving up human control where necessary.
My vision: Transform news consumption from passive and often frustrating to active and stimulating, offering content that ignites curiosity and promotes continuous learning.
The project targets a broad audience: from science enthusiasts to casual readers, to those seeking alternative information that is lighter but not superficial. It is, in essence, my editorial and technological experiment that unites personal passion and the search for innovative solutions.
Chapter 2 β Sources and licenses
Before delving into specific source selection, it's important to acknowledge the fundamental role of Creative Commons in this project. The non-profit organization founded in 2001 has revolutionized the concept of knowledge sharing, creating a system of standardized licenses that allow authors to specify exactly how their content can be reused. Without this legal framework, a project like mine would not have been possible: Creative Commons has made the world of open licenses accessible and comprehensible, democratizing access to scientific and cultural information.
Creative Commons: Their documentation, available at creativecommons.org, was my main guide to understanding the differences between CC BY, CC0 and Public Domain, providing me with the theoretical and practical foundations for navigating the complex world of open licenses.
Source selection was one of the most complex and formative challenges of the entire project. Not coming from the editorial sector, I had to thoroughly study the landscape of open licenses, understanding the differences between Creative Commons BY, CC0 and Public Domain, and learning to correctly interpret reuse clauses.
My goal was clear: use exclusively content from sources that guaranteed legal and transparent reuse. For this reason, source selection remained a procedural and manual phase: I verified each source individually, checking not only the declared license, but also the consistency between what was reported and the actual conditions.
My fundamental ethical principle: The system acquires content through RSS feeds or official APIs, avoiding any form of scraping. This choice is not only a legal precaution, but also an act of respect towards original authors.
Manual preselection allowed me to eliminate at the root the problem of false positives encountered in initial tests with automatic selection, where AI tended to erroneously classify sources as "reusable" when they were not. This approach also highlighted the importance of maintaining a balance between automation and human control in the most delicate phases of the process.
Verified and used sources
Below is the complete table of sources I manually selected and verified for the project, with related links to licenses to ensure full transparency:
| # | Source | License | Declared license link |
|---|---|---|---|
| 1 | Quantum Journal | CC BY 4.0 | Terms & Conditions |
| 2 | arXiv | CC BY / CC0 | License Help |
| 3 | Data.gov | Public Domain | Privacy Policy |
| 4 | Frontiers (all journals) | CC BY | Open Access |
| 5 | MDPI | CC BY 4.0 | Authors Rights |
| 6 | PeerJ | CC BY 4.0 | Publications |
This curated selection represents a balance between scientific quality, thematic variety and legal reliability. Each source is monitored periodically to verify that license conditions remain unchanged and that content quality remains consistent with project standards.
Transparent Attribution & Multi-Author Management
A core tenet of ethical scientific communication is the rigorous recognition of the original contributing researchers. Academic papers are inherently collective endeavors, often authored by dozens of researchers across global universities and research institutes.
To fully honor CC BY 4.0 requirements, the ingestion pipeline features a dedicated author extraction and parsing module: it inspects structured metadata (such as dc:creator elements and item.Authors collections in RSS feeds), sanitizes spurious characters, and attaches full co-author credits alongside direct backlinks to primary sources. Every article published on 3CN serves as a transparent gateway to primary science, upholding moral attribution rights and intellectual integrity.
Chapter 3 β GDPR and Impact on Design
The General Data Protection Regulation (GDPR), which came into force on May 25, 2018, has profoundly transformed the European digital landscape, imposing new responsibilities and strict constraints in personal data management. This regulation, created to strengthen the protection of European citizens' fundamental rights, has also had a significant impact on my project, steering me towards innovative solutions and alternatives to traditional data collection mechanisms.
Obligations and Constraints for Websites
GDPR establishes fundamental principles that every website owner must comply with:
Main GDPR Obligations
- Explicit consent: Collection of clear and unambiguous consent for data processing
- Transparent information: Clear communication about purposes, methods and duration of processing
- Data subject rights: Guarantee of rights of access, rectification, erasure and portability
- Privacy by design: Integration of data protection from the design phase
- Data breach notification: Notification of breaches within 72 hours to competent authorities
- Records of activities: Detailed documentation of processing carried out
Failure to comply with these provisions can result in administrative sanctions of up to 4% of annual worldwide turnover or β¬20 million, in addition to possible compensation claims from data subjects. For regulatory insights, please refer to the official website of the Data Protection Authority.
Project Impact: Constraints and Opportunities
Rigorous application of GDPR initially represented a significant obstacle for some functionalities I had planned. In particular, two aspects of the project were directly influenced:
Newsletter and email collection: Implementing a newsletter system would have required managing personal data (email, preferences, navigation metadata) with all related compliance requirements: granular consent, detailed information notices, opt-out systems, secure data storage and management of deletion requests. The bureaucratic and technological complexity, combined with compliance costs, made this option unsustainable for an individual project.
Contact form: Even a simple contact form would have involved collecting and processing personal data, requiring implementation of adequate security measures, specific information notices and management of data subject rights. This aspect, apparently marginal, proved to be an additional element of complexity to avoid.
Transparent Privacy Verification
To ensure maximum transparency, you can independently verify the compliance of this site using CookieMetrix or similar tools.
The scan will confirm the absence of tracking cookies and the presence of only technical elements necessary for the Blazor Server application to function.
The Solution: Social Media and Alternative Engagement
Rather than seeing GDPR as a limitation, I interpreted these constraints as an opportunity to explore innovative approaches to content distribution and audience interaction. The adopted solution is based on two main pillars:
LinkedIn Integration
I chose LinkedIn as the main platform for automatic content distribution. This choice presents several strategic advantages: LinkedIn autonomously manages all GDPR-related aspects for its users, offers a professional audience already interested in scientific and technological content, and allows natural engagement through comments, shares and reactions. Each article published on the site is automatically shared on LinkedIn with an optimized presentation post, creating a direct bridge between static content and dynamic community.
Dedicated Page for Contacts and Comments
I developed a dedicated page LinkedIn Page (3CN) that functions as an interaction hub, without directly collecting personal data. This page directs users to appropriate social channels for feedback, questions or collaborations, maintaining editorial control on the main site while delegating communication management to social platforms that already have the necessary GDPR-compliant infrastructure.
Blazor Server: Privacy-First Architecture by Design
The search for maximum GDPR compliance has also profoundly influenced the architectural choices of the project, guiding the decision towards Blazor Server as the development framework. This technology stands out for an intrinsically privacy-friendly approach, eliminating at the root the need to manage traditional technical cookies.
Unlike classic web applications, Blazor Server manages the entire application logic server-side, maintaining user interface state through a persistent SignalR WebSocket connection. This paradigm completely eliminates dependence on cookie-based session mechanisms, making the application naturally compliant with the data minimization principles provided by GDPR.
Technical Advantages for Privacy
- Zero Session Cookies: Application state is maintained in server memory, not in the browser
- WebSocket Communication: Elimination of traditional HTTP requests and related tracking headers
- Intrinsic Security: Natural immunity to CSRF attacks without need for antiforgery tokens
- Centralized Control: Complete management of data lifecycle on controlled server
Technical security note: Since Blazor Server does not implement the traditional HTTP request/response paradigm but uses exclusively WebSocket for client-server communication, it is naturally immune to Cross-Site Request Forgery (CSRF) attacks. This characteristic completely eliminates the need to implement UseAntiforgery mechanisms and related validation tokens, further simplifying the architecture and reducing the application's security footprint.
This technological choice has therefore produced a double benefit: on one hand it guaranteed native GDPR compliance without functional compromises, on the other it generated a cleaner, more secure and performant architecture compared to traditional alternatives based on cookies and HTTP sessions.
Passwordless Administrative Security (MagicLink & OTP)
The "zero unnecessary data" philosophy extends directly to editorial administration. To access sensitive review and scheduling dashboards, I eliminated traditional static passwords β prone to data breaches and credential stuffing β in favor of a Passwordless authentication model based on single-use MagicLinks and OTPs.
The system generates high-entropy cryptographic tokens dispatched via secure channels, active for a single session and immediately invalidated upon first use. To neutralize response timing attacks (timing attacks), token validation utilizes constant-time comparison algorithms, enforced with strict rate limiting and secure disaster recovery mechanisms.
Unexpected Benefits of Compliance: The "GDPR-native" solution has generated unexpected advantages: it has significantly simplified the project architecture, eliminating the need for user databases, email management systems and complex security infrastructures. It has also oriented the project towards greater transparency and sustainability, concentrating resources on content quality rather than personal data management.
Chapter 4 β EU AI Act: Transparency, Governance & Regulatory Compliance
With the formal adoption of Regulation (EU) 2024/1689 (widely known as the European AI Act), the European Union established the world's first comprehensive legal framework for trustworthy, transparent, and human-centric Artificial Intelligence. The regulation enforces a proportionate Risk-Based Approach, categorizing AI systems based on their potential impact on fundamental rights and safety.
3CN Classification under the European AI Act
The 3CN platform operates as a Limited Risk AI System / General Purpose AI (GPAI) for scientific synthesis and outreach. For this category of applications, EU legislation does not impose prohibitive barriers, but mandates strict, enforceable obligations regarding Radical Transparency, Human Oversight, and Copyright Protection (Articles 50, 52, and 53).
"AI Act Compliant by Design" Philosophy: 3CN was architected from inception to proactively exceed AI Act requirements, turning regulatory compliance from an administrative hurdle into a core competitive asset of editorial trust for academia and the reading public.
The Five Pillars of AI Act Compliance in 3CN
The matrix below outlines the direct alignment between European legislative mandates and our platform's concrete architectural solutions:
| AI Act Requirement | EU Legal Mandate | 3CN Architectural Solution |
|---|---|---|
|
1. AI Labeling & Transparency
Art. 50
|
Mandatory disclosure informing end users whenever texts, summaries, or synthetic voices are generated or altered by AI models. | Prominent UI badges (AI Summary), transparent declaration of the specific LLM model used, audio badges (β¨ HD / π» TTS), and machine-readable JSON-LD semantic metadata for search engines. |
|
2. Meaningful Human Oversight
Art. 14
|
Prevention of opaque, "black-box" autonomous publishing. Human operators must be able to monitor, override, steer, or halt the system at any point. | Native Human-in-the-Loop architecture: zero uninspected articles go live. Every single AI draft must be reviewed, fine-tuned, or discarded inside the private Editorial Review Console. |
|
3. Copyright & Source Provenance
Art. 53
|
Full adherence to the EU Digital Single Market (DSM) Copyright Directive, training data transparency, and uncompromised moral attribution. | Ingestion strictly restricted to Open Access repositories (arXiv, CC BY 4.0, CC0). Full automated attribution of all original authors (item.Authors), canonical source links, and clear licensing tags. |
|
4. Hallucination & Bias Mitigation
Art. 15 & 55
|
Implementation of technical guardrails to suppress factual hallucinations, semantic drifts, cognitive bias, and misinformative content. | Internal Reviewer Step in the prompt (multi-dimensional score for scientific rigor, objectivity, and clarity), automated safety filters against commercial spam, plus human expert fact-checking. |
|
5. Traceability & Audit Trail
Art. 12
|
CapacitΓ di ricostruire a ritroso il comportamento del sistema per scopi di conformitΓ , controllo e analisi forense. | Structured immutable logging (NLog on SQL Server) recording every batch: LLM latency, self-scoring metrics, system prompts applied, and human editorial decisions. |
A Benchmark for Ethical Science Communication: 3CN demonstrates that rigorous compliance with the European regulatory framework (GDPR + AI Act) does not stifle innovation; rather, it provides the firmest catalyst for quality, reliability, and academic credibility.
Chapter 5 β Human-in-the-Loop (HITL) & Academic Foundations
In the contemporary discourse surrounding Artificial Intelligence adoption, debate is often polarized between total black-box automation ("end-to-end") and purely manual workflows. The 3CN project demonstrates that highest value is unlocked by adopting the Human-in-the-Loop (HITL) paradigm: a systems architecture where algorithms and humans cooperate in a continuous closed-loop feedback cycle, marrying machine computational velocity with human ethical and qualitative discernment.
Why Is It Termed a "Loop" (Closed Cycle)?
Unlike conventional linear workflows (Input → Unsupervised AI Processing → Public Release) where generative hallucinations and misinterpretations propagate directly to readers, a Closed Loop architecture positions the human editor as an active formative node within the process:
- Stage 1 β Proposal & Self-Scoring (AI): The language model ingests the raw paper, generates a bilingual draft (IT/EN), and self-evaluates quality across objective dimensions (positivity, scientific rigor, clarity).
- Stage 2 β In-the-Loop Editorial Intervention (Human Governance): The editor reviews the proposal. In the presence of nuances or weaknesses, the editor does not merely discard the work but re-injects targeted corrective feedback into the cycle (prompt feedback), guiding the model towards an enhanced revision or directly refining the copy.
- Stage 3 β Loop Closing & Release: Explicit human sign-off closes the loop, triggering downstream neural HD audio synthesis and scheduled distribution.
Academic Foundations & The arXiv Connection
The theoretical robustness of this methodology is rooted in international scientific literature. One of the seminal reference surveys in this domain is:
Academic Reference Paper:
"A Survey of Human-in-the-Loop for Machine Learning" (arXiv:2108.00941)
β This comprehensive survey proves that integrating human feedback within machine learning loops drastically suppresses error rates, bolsters robustness against out-of-distribution inputs, and ensures ethical alignment with human intent.
It is particularly noteworthy that arXiv (hosted by Cornell University) is both the origin of this foundational research and one of the open-access scientific repositories natively integrated into 3CN under Creative Commons CC BY / CC0 terms. This synergy highlights the circular coherence of our platform: leveraging open science to understand AI, and employing AI to disseminate open science.
The Three Pillars of the 3CN Hybrid Framework:
1. Scalable Efficiency: AI orchestrates heavy semantic parsing, cross-translations, and conceptual synthesis in seconds.
2. Ethical Integrity: Human verification of CC BY 4.0 open licenses and editorial validation completely eradicates hallucinations and copyright infringement.
3. Operational Continuity: The system adapts around human guidance, delivering consistent, dependable, and transparent publication quality.
Chapter 6 β Operational Workflow & Processing Pipeline
The pipeline represents the operational heart of my project: a continuous and integrated flow that, starting from information gathering, leads step by step to content publication and distribution. In this architecture, AI intervenes at moments when it can best express its analysis, generation and review capabilities, while the most critical phases from legal and organizational perspectives remain under my direct control.
Interactive Pipeline Workflow
The flow opens with reading and acquiring feeds from sources I have preselected. This phase is intentionally procedural: I have manually verified all sources to guarantee license compatibility and material quality. The system periodically queries RSS feeds or official APIs, acquiring title, abstract, author, publication date, URL and declared license, which you will find at the bottom of each published article.
It is essential to always verify that the generated article is consistent with the reference scientific publication. Generally, original publications are very articulated and detailed studies, which offer valuable insights for subsequent in-depth analysis and represent a source of high-quality content for further editorial developments.
This is followed by license verification and ethical compliance, also procedural. Each acquired element is compared with the list of licenses I have defined as permitted (CC BY, CC0, Public Domain). I do not scrape the complete content: I only use data present in the feed, respecting the author's will and usage conditions.
At this point AI comes into play with thematic filtering and deduplication. The analysis is not limited to keyword checking, but uses semantic understanding models to evaluate relevance to the objectives I have set. Articles about crime news, politics or gossip are excluded, and any duplicates already present in the database are removed.
After passing the filter, AI proceeds to preliminary classification and rating assignment. Each article is evaluated on four dimensions I have defined: positivity, scientificity, novelty and expository clarity. Each criterion is assigned a score from 1 to 10, and the arithmetic mean determines the overall rating.
The WRITER phase is entirely entrusted to AI. Here the content is rewritten following the editorial rules I have established: clear and accessible language, positive and curious tone, absence of personal opinions, rigorous respect for licenses and text originality. The objective I have set is to transform a technical abstract into a popular science article that maintains information accuracy but makes it accessible to a broad audience.
When the quality score does not reach the minimum threshold I have established, the REVIEWER phase comes into action. Here too AI is the protagonist, but with an iterative approach I have designed: the text is reworked multiple times, up to a maximum of ten cycles, trying to correct weaknesses and improve evaluation parameters.
My key discovery: Comparative tests I conducted showed that three separate AI calls required 60-70% more time than a single unified call, in addition to greater management complexity.
The Neural Voice Synthesis (TTS) phase converts the approved article into a high-definition audio track for mobile listening (with automatic client-side fallback to the browser speech engine). For the full technical breakdown on neural models, the Voice Gallery, and dual-engine architecture, see Chapter 8: Neural Voice Synthesis.
Check out the step-by-step practical guide with screenshot callouts and configuration tables in the User & Admin Manual.
The Neural Vector Indexing (ONNX) phase automatically computes 384-dimensional dense embeddings for every new article, storing them in SQL Server database to enable instant conceptual searching. For full architectural breakdown and performance benchmarks, see Chapter 11: Neural Semantic Search.
The cycle closes with publication on the site in dual language (Italian and English), dynamic generation of aggregated RSS feeds, and automated sharing on LinkedIn, expanding distribution reach and engaging an interested professional audience.
Chapter 7 β The orchestrator prompt: architecture and operational logic
The beating heart of the entire system I developed resides in a single complex prompt, the result of numerous iterations and refinements. This component, apparently simple in its textual form, actually represents the most critical and innovative element of my project: a true "orchestra conductor" capable of coordinating distinct roles, managing complex decisional flows and guaranteeing structured and coherent outputs.
Technical requirement I discovered: The effectiveness of this approach depends on the AI model's ability to support MoE (Mixture of Experts) functionality, indispensable for effectively managing the impersonation of distinct roles within the same prompt.
The design of this prompt was an evolutionary process in my journey. The initial approach I had adopted involved separate calls for each phase, but this system proved inefficient on multiple aspects, requiring 60-70% longer times and complex procedural management of various intermediate outputs.
The tripartite structure I developed
STEP 1 β WRITER defines the editorial identity of my system. Here I established the primary objectives: transform scientific and technical content into texts accessible to young audiences, maintaining rigor and accuracy but adopting a fresh and engaging tone. The editorial rules I defined are particularly detailed because they represent the project's DNA: absolute originality to avoid copyright issues, neutrality to guarantee credibility, expository clarity to reach the target.
Example of specific rule I inserted:
"Style: rigorously Italian, not literal translations; attention to Saxon genitive, to be translated according to Italian grammar."
STEP 2 β REVIEWER introduces a self-evaluation and iterative improvement mechanism I designed. The system assigns scores from 1 to 10 on four dimensions I chose β positivity, scientificity, novelty and expository clarity β and calculates an average that determines whether content is acceptable or needs reworking.
This section includes safety filters I implemented to automatically exclude content not consistent with my editorial line: non-scientific articles, promotional material, sensitive topics like serious diseases. The improvement cycle can repeat up to ten times, a limit I established to avoid infinite loops but sufficient to allow significant optimizations.
Structured output management
STEP 3 β OUTPUT represents the most significant innovation I introduced from a procedural integration perspective. Instead of returning free text, the system produces a structured JSON object with predefined fields, each optimized for a specific function within the pipeline I created.
The advantage I obtained: This choice eliminates the ambiguity typical of textual output and makes results immediately usable by subsequent phases without need for parsing or interpretation.
The JSON structure I designed includes elements in dual language (Italian and English), URL slugs optimized for SEO, hashtags calibrated for social media and a "BonusExpert" section with technical insights for more advanced readers. Each field has specific compilation instructions I defined: length, tone, style, technical characteristics.
A fundamental aspect is the rating threshold calibration I had to optimize through testing. In my initial tests, thresholds too high (above 8.0) produced an excessive number of discards, while thresholds too low (below 6.0) let through content of insufficient quality. The threshold I currently use, dynamically configurable, represents an optimal compromise between quality and productivity I achieved through experience.
The orchestrator prompt I developed therefore represents much more than a simple textual instruction: it is an integrated quality control system, an automatic editor and a specialized translator, all condensed into a single conversational interface. Its design required months of refinements, tests and corrections, but the final result is a powerful, reliable and scalable tool.
Chapter 8 β Neural Audio TTS & Voice Gallery Integration
One of the most rewarding and impactful extensions of the project has been its multimodal evolution: upgrading the platform from a text-only news aggregator into an immersive augmented listening experience. In today's dynamic information landscape, on-the-go consumption β while driving, exercising, commuting, or taking screen-free breaks β has become paramount. However, user satisfaction hinges on natural vocal timbre, expressive cadence, and precise pronunciation of specialized scientific vocabulary.
Bridging the Gap: From Robotic Browser Voices to Deep Neural Models
Traditional client-side synthesis via the browser Web Speech API suffers from notable shortcomings: mechanical and monotonous delivery, heavy reliance on local voices installed on the user's operating system (leading to stark discrepancies across iOS, Android, and Windows), and frequent mispronunciations of compound words or scientific terminology.
The Quality Leap: To achieve true editorial quality, I integrated neural Text-to-Speech (TTS) driven by deep transformer architectures, capable of generating fluid, human-grade speech complete with lifelike emotional nuances, syntactic breathing pauses, and proper punctuation handling.
Azure AI Speech Ecosystem & Microsoft Voice Gallery
The selection and benchmark of voice profiles centered on the cloud capabilities of Azure AI Speech and the interactive Azure AI Voice Gallery , showcasing hundreds of studio-quality 48 kHz neural voices across global languages.
Following comprehensive phonetic stress testing against AI-generated content, I calibrated a dedicated, high-clarity neural voice profile for each language, powering both the main summary and the Expert Bonus section:
| Language | Neural Model | Timbre & Tone | Intended Target |
|---|---|---|---|
| Italian (IT) | it-IT-AlessioMultilingualNeural |
Warm, authoritative, narrative cadence and clarity | Complete article playback (Summary + Expert Bonus) |
| English (EN)* | en-US-AndrewMultilingualNeural |
Balanced international English with reassuring warmth | Global English edition (Summary + Bonus) |
* Note on progressive migration: Because high-definition (HD) neural audio generation requires dedicated server-side rendering time and compute resources, the migration process is being rolled out incrementally: it is currently active and prioritized for Italian content, and will subsequently be extended to the global English edition.
Benchmark & SSML Fine-Tuning: Leveraging Speech Synthesis Markup Language (SSML), the pipeline injects calibrated micro-pauses between headings and paragraphs, fine-tunes speech rate (0.96x for optimal scientific clarity), and guarantees seamless flow without jarring robotic breaks.
Dual-Engine Architecture: High-Definition & Resilient Fallback
To combine studio audio quality with operational efficiency (zero client-side download overhead and controlled cloud costs), I engineered a Dual-Engine pipeline strategy:
- Neural HD Layer (Server-Side Batch Pre-Rendering): During the editorial review workflow, the admin can trigger high-definition neural synthesis. The backend interfaces with Azure AI Speech, downloads the optimized MP3 stream, and stores it in static CDN storage. End users enjoy zero-latency, instant playback with a distinct β¨ HD badge.
- Client-Side Fallback Layer (Web Speech API): For articles without pre-rendered audio or in offline contexts, the Blazor player automatically falls back to the native browser speech engine with a π» TTS indicator, ensuring 100% service availability under any network condition.
Adaptive & Accessible Player UI: The embedded audio player is seamlessly styled across both Light and Dark themes, featuring responsive play/pause/stop controls, real-time progress indicators, and full accessibility compliance for screen readers and visually impaired users.
Chapter 9 β Software Architecture & Technology Stack
I evaluated various technological architectures, initially orienting myself towards Blazor WebAssembly integrated with Web API. However, this approach revealed rigidity incompatible with Agile methodology: refactoring times necessary to implement direction changes often exceeded those required for business logic development. Consequently, I opted for migration to Blazor Server, which offers greater flexibility and more sustainable development times.
The strategic choice of Blazor Server 8
My decision to adopt Blazor Server 8 as the development framework was profoundly influenced by the methodological approach I wanted to follow. Knowing I had to face an experimental project with many unknowns, I opted for Agile management that would allow me to "do and redo" various parts of the system iteratively and reactively.
The Agile advantage I obtained: With Blazor Server, frontend and backend are effectively in a single project. I didn't use intermediate APIs - everything communicates directly through the framework, allowing me a truly Agile approach with much faster development cycles.
Blazor Server 8 allows me to build interactive web applications using C# and the entire .NET ecosystem, eliminating the need to resort to multiple stacks and different languages. This choice allowed me to maintain a coherent development environment, drastically reducing cognitive complexity and accelerating implementation times for changes.
Practical experience: During development, I could modify the AI processing pipeline and immediately see results in the administrative dashboard, without having to recompile, redistribute or synchronize separate components.
Real-time and interactivity
SignalR integration enables real-time updates that would have been much more complex to implement with an API-based architecture: batch progress status, arrival of new articles or modification of scheduling become immediately visible without reloading the page. This functionality, crucial for monitoring an automated system, was implemented in a few lines of code.
Using Blazor Server has significantly simplified cache management for today's articles. Since this content remains unchanged during the day, it's inefficient to continuously query the database. A scheduled event at midnight expires caches and loads new articles; simultaneously, a trigger connected to this event uses APIs to automatically publish a presentation post on LinkedIn.
Point of view: I deliberately chose not to use ready-made CSS frameworks like Tailwind CSS or MudBlazor, considering them too standardized and limiting for personal creative expression. I preferred to implement a custom styling system: the dark theme is more eccentric and distinctive, while the light one maintains a simple and professional approach.
From a visual experience perspective, the interface I designed is responsive and optimized to work on desktop, tablet and smartphone. The dynamic theme system I implemented allows real-time switching from light to dark mode, adapting to user preferences. Multilingual support I implemented leveraging .NET's native functionality, allowing me to offer content in Italian and English without duplicating logic or interfaces.
Editorial Review Board Dashboard
The operational core for Human-in-the-Loop oversight is the private Editorial Review Console. This advanced interface empowers the administrator to inspect every AI-processed article in real-time before public release:
- Multi-Metric Inspection: Detailed breakdown of quality scores (Positivity, Scientificity, Novelty, Clarity) and verification of extracted original author credits.
- Rapid Decision Workflow: Capability to approve articles for scheduled publishing, discard them permanently, or trigger guided AI re-elaboration with custom prompt instructions.
- Direct Editorial Editing: Fine-grained editing of bilingual titles, body summaries and bonus insights to polish phrasing and tone.
- One-Click Neural Audio Generation: On-demand dispatching of high-definition TTS synthesis with instant MP3 file pre-rendering.
Quartz.NET Batch Scheduler & Live Terminal
Asynchronous background job orchestration is managed via a dedicated Batch Control Console, powered by Quartz.NET with persistent SQL Server storage. Through this operational console, administrators can inspect scheduled nightly batch runs, adjust cron schedules live, launch extraordinary batch cycles with a single click, and observe streaming runtime logs directly on screen.
Ultra-Lightweight Custom ORM (DbCore Pattern)
To maximize read/write throughput and prevent external ORM bloat, I engineered a custom ORM framework adhering to the DbCore pattern. Utilizing declarative annotations ([DbEntity], [DbKey], [DbColumn]), the architecture ensures strongly-typed mapping, optimized SQL queries, built-in injection safety, and minimal memory footprint across domain entities and audit trails.
Dynamic AI Model Management & Automatic Fallback
A standout architectural element is the integration with OpenRouter featuring a dynamic fallback strategy: should the primary model (such as mistral-small-3.2-24b) become saturated or hit rate limits, the pipeline automatically fails over across high-performance alternatives (gpt-oss-120b, llama-3.3-70b, gemini-2.0-flash), guaranteeing 100% operational continuity.
Practical Model Testing Experience: I conducted extensive comparative benchmarks across leading open-source models. Mistral Small delivered the optimal balance: 2-3s response times, flawless Italian phrasing, and strict adherence to structured JSON schemas. Larger models like DeepSeek provide rich analytical depth with higher latency (60-90s). The dynamic architecture enables seamless model switching via simple configuration updates without application recompilation.
Observability and Cloud-Ready Scalability
The architecture embeds enterprise-grade logging (NLog) tracking every operation: LLM API latency, RSS HTTP response codes, voice synthesis telemetry, and an immutable audit trail of all editorial approvals. The platform is architected for containerization and horizontal scaling, fully leveraging .NET 10 performance and SQL Server reliability.
Chapter 10 β Accessibility & Digital Inclusion (WCAG 2.1 AA)
The 3CN platform is designed following the principles of universal accessibility (W3C WCAG 2.1 Level AA and European Accessibility Act), ensuring scientific knowledge is fully accessible to everyone, including blind and visually impaired users, people with dyslexia, or motor disabilities.
Integrated Accessibility Features:
- Voice Reader (Neural HD Audio & Web Speech): Every article and expert bonus insight can be listened to with natural speech synthesis.
- Reflow Pinch Zoom (A+ / A-): 2-finger touch gesture on mobile and trackpad to scale text size with automatic reflow (zero horizontal scroll) and tactile haptic vibration feedback.
- Keyboard Navigation & Skip Link:
Tabkey navigation with a "Skip to main content" button to access the article immediately without stepping through the entire header, backed by a high-contrast focus ring. - Screen Reader Ready: Full support for VoiceOver, TalkBack, and NVDA via ARIA landmark roles and dynamic document language sync (
<html lang="it|en">). - High Contrast & Dark/Light Theme: Calibrated color palettes to prevent visual fatigue and aid reading for users with photophobia or astigmatism.
Chapter 11 β Neural Semantic Search & ONNX Vector Embeddings
Conventional search engines for blogs and news portals rely historically on exact lexical matching (traditional keyword lookup or BM25 algorithms). If a user searches for "non-polluting vehicles", a traditional engine returns zero articles if the titles contain only the terms "electric cars" or "hydrogen mobility". To bridge this conceptual divide, the 3CN platform integrates an in-process neural semantic search engine based on dense vector embeddings and high-performance inference with Microsoft ONNX Runtime.
1. The Neural Model: all-MiniLM-L6-v2
The algorithmic core of the search is the all-MiniLM-L6-v2 model, developed within the open-source Sentence-Transformers framework based on Microsoft's distilled Transformer architecture. With 22.7 million parameters (approx. 0.023B), a 6-layer self-attention structure, and a hidden dimension of 384 units, the model is specifically trained to map sentences and documents into a continuous 384-dimensional vector space.
Official References & Model Downloads:
- Hugging Face model repository & weights: huggingface.co/sentence-transformers/all-MiniLM-L6-v2
- Inference engine documentation: Microsoft ONNX Runtime Engine (onnxruntime.ai)
2. INT8 Dynamic Quantization: Maximum Efficiency at Zero Cost
The original 32-bit floating-point (Float32) Transformer model occupied approximately 120 MB of RAM. To enable in-process execution on shared-host servers without degrading application load times, we performed dynamic 8-bit integer quantization (INT8) using ONNX Runtime's official toolkit (onnxruntime.quantization.quantize_dynamic).
INT8 Quantization Benchmarks & Benefits:
- Memory Footprint Reduction: The compressed model file is only 22.4 MB (an 81.1% reduction from the initial 118.5 MB).
- Computational Speedup: Single-sentence embedding computation time on standard commodity CPU dropped from ~48ms to 14.6ms (3.3x faster).
- Preserved Mathematical Accuracy: The 8-bit weight matrix preserves over 99.2% cosine similarity correlation compared to the unquantized Float32 model.
- Zero External API Dependencies: Inference runs entirely in-memory locally, eliminating third-party API token costs, network roundtrips, and rate limits.
3. Vector Storage & Ultra-Fast Cosine Similarity
The 384-dimensional vectors computed for each article are L2-normalized ($\|v\|_2 = 1$) and stored directly in the relational database as a compact binary stream (VARBINARY of exactly 1,536 bytes per article). The entire historical news archive takes up just 3.5 MB of total vector storage (less than 0.35% of database quota).
Thanks to prior L2 normalization, Cosine Similarity simplifies mathematically to a simple Dot Product (scalar product), enabling the engine to compare a query against thousands of articles in under 2 milliseconds on a single CPU core.
4. On-Demand Lifecycle & Sliding Lease Memory Manager
To maximize system memory efficiency on production environments, the semantic engine uses an on-demand sliding expiration lease pattern:
Intelligent Memory Lifecycle:
- Cold Standby (0 MB RAM): At web application startup, the ONNX model is not loaded in memory (0 MB RAM consumption).
- On-Demand Boot (~40ms): When a user runs a search query or triggers the command palette, the engine boots instantaneously and computes embeddings.
- Sliding Expiration (5 Minutes): The service stays warm in memory for 5 minutes after the last search; each new query pushes the idle timer forward another 5 minutes.
- Garbage Collection & Full Release: After 5 minutes of inactivity, the ONNX session is disposed and memory is immediately reclaimed via forced Garbage Collection.
5. How to Test Semantic Search on the Portal
You can experience neural conceptual search live directly in the search bar of the /news page:
The 2 Dedicated Search Filters:
- Filter π§ AI Results Only: Isolates articles where the neural network found high conceptual affinity with your query, even if the exact keywords do not appear.
- Filter π€ Exact Words Only: Shows classic traditional lexical search based strictly on exact word matches.
6. Search Comparison: Neural AI vs Exact Keywords
The following table illustrates a side-by-side comparison (2 neural AI conceptual matches and 2 exact keyword matches):
| User Search Query | Match Type | Understood Concept / Terms | Retrieved Article |
|---|---|---|---|
| "non-polluting vehicles" | Neural AI | Electric Vehicles & Green Mobility | How do you design a self-balancing vehicle? |
| "web pirates and ransom" | Neural AI | Cybersecurity & Ransomware | Is the web truly safe? How AI defends against invisible attacks |
| "urban pollution" | Exact Match | Exact keyword match in title | How can we predict urban pollution with record accuracy? |
| "space telescope" | Exact Match | Exact query terms in title | New deep space telescope images reveal distant galaxies |
Technical SEO, GEO (Generative Engine Optimization) & Real-Time IndexNow
In the era of Artificial Intelligence, online discoverability is undergoing the most radical transformation since the inception of the World Wide Web. Traditionally, Search Engine Optimization (SEO) revolved around competing for the top ten blue links on Google by optimizing keywords and acquiring backlinks. Today, this landscape has shifted toward Generative Engine Optimization (GEO): millions of users no longer search by typing isolated keywords, but interact through natural dialogue with generative answer engines such as ChatGPT Search, Perplexity, Claude, and Google Gemini.
For a scientific dissemination platform, the goal is no longer just "getting found", but being architected to be understood, synthesized, and cited as an accredited primary source by AI models, all while achieving instantaneous real-time indexing. To achieve this, MantoX Blog 2 engineered a four-tier architecture combining modern semantic web standards, real-time push indexing protocols, and native data structures tailored for Large Language Models.
1. The Real-Time Revolution of IndexNow: Search Engines' Best-Kept Secret
For decades, search indexing operated on a Pull model: a website publishes a new story, appends it to an XML sitemap (sitemap.xml), and waits passively. Search engine bots (web crawlers) must periodically revisit the sitemap, compare timestamps, and decide when to crawl. This round-trip often takes days or even weeks, introducing an unacceptable delay for fast-moving science and breaking breakthroughs.
MantoX Blog 2 implements the open IndexNow protocol, spearheaded by Microsoft Bing and supported by a growing network of global engines (including Yandex, Seznam.cz, and Naver). While still relatively unknown to the general public, IndexNow is recognized by web architects as one of the most substantial search infrastructure breakthroughs in recent years.
How IndexNow Flips the Paradigm (From Pull to Push):
- Instantaneous Push Notification: The exact millisecond an article receives human editorial approval in our admin dashboard, our .NET backend issues a secure cryptographic call directly to the central IndexNow API, transmitting the newly published URL.
- Crawling in Seconds: All participating search engines are notified simultaneously: the new article is crawled and indexed in Bing and partner engines within minutes, eliminating all lag.
- Eco-Efficiency & Digital Sustainability: By eliminating millions of wasteful automated crawler scans on unchanged pages, IndexNow drastically curbs unnecessary internet traffic and lowers the computational energy consumption of data centers worldwide.
2. GEO Standards `llms.txt` & `llms-full.txt`: Speaking the Native Language of LLMs
While traditional search engines parse web pages through HTML tags and CSS layouts, Large Language Models (such as ChatGPT, Claude, and Perplexity) require dense, semantic, noise-free text that is easy to ingest. Following the open llmstxt.org specification, MantoX Blog 2 serves two dynamic, lightweight endpoints:
Native Endpoints for Generative AI:
/llms.txt(Concise Manifest): A clean, dynamic Markdown file that provides AI bots with an architectural overview of the blog, editorial guidelines, category taxonomies, and links to top news stories./llms-full.txt(Complete Knowledge Base): The entire publication archive rendered in hierarchical Markdown, featuring bilingual abstracts, expert insights, and primary source links, served in a single zero-overhead HTTP request.
Thanks to this architecture, when users ask a generative AI about a recent scientific discovery or physics paper covered on MantoX Blog 2, the AI can directly retrieve the context, cite our platform as a verified source, and provide accurate academic attribution.
3. Structured Semantic Graph: High-Precision Schema.org `@graph`
To communicate unambiguously with Google News algorithms and semantic parsers, every article dynamically injects a unified 5-dimensional JSON-LD (Schema.org) graph in the <head>:
NewsArticle: Formalizes article metadata, bilingual headlines, authorship, ISO 8601 publication and modification timestamps, and certified publisher data.AudioObject: Links the neural HD podcast MP3 track with technical audio bitrate, encoding, and estimated playback duration.SpeakableSpecification: Instructs voice assistants (Google Assistant, Alexa, Siri) and screen readers which CSS regions (title, summary, bonus insights) should be read aloud during audio playback.BreadcrumbList: Defines semantic navigation hierarchy (Home βΊ Category βΊ Article), allowing search engines to display rich breadcrumbs in search results.FAQPage& Key Takeaways: Encodes interactive "Smart Q&A" pills (Explain it simply, Pros & Cons, What's ahead) as questions and answers, enabling Google SERP expandable rich snippets.
4. Dynamic OpenGraph Social Preview Engine (`/og-image/{slug}`)
Social media sharing (WhatsApp, Telegram, LinkedIn, π, Facebook) is a primary distribution channel for digital publishing. Rather than relying on generic fallback images, MantoX Blog 2 features a dedicated OgImageController that generates customized, high-definition OpenGraph preview cards on-the-fly for every article.
Each card features the article title, category badge, estimated reading time, neural podcast indicator, and the portal's signature visual gradient, ensuring high visual clarity across all devices and social feeds.
5. Editorial Transparency & EEAT Trust Signals
Google's EEAT (Experience, Expertise, Authoritativeness, Trustworthiness) quality rater guidelines and modern AI models reward radical transparency in digital publishing. On our platform, every article features a prominent Trust Box displaying:
Reader Trust & Transparency:
- The exact AI model utilized for conceptual extraction and synthesis.
- Human editorial review and validation (Human-in-the-Loop) certifying ethical and legal adherence.
- A direct clickable chip linking to the original primary source (academic DOI or peer-reviewed open paper).
Conclusions, Personal Journey & Future Outlook
Looking back at the entire journey, this project has proven to be a voyage as challenging as it was formative, where each phase represented a technical, methodological and personal challenge. My initial idea of entrusting Artificial Intelligence with the entire pipeline, from source selection to publication, clashed with the reality of a domain β the editorial one β that requires particular attention to content provenance and legal compliance.
Fully automatic source management showed evident limitations in my tests: too many false positives in license classification, with sources erroneously labeled as reusable, and an unsustainable expenditure of time and resources. This led me to a crucial decision: adopt a hybrid model, where source preselection and editorial planning remain under my procedural control, while AI intervenes in steps where it can express maximum added value.
AI Brainstorming
Collaborative brainstorming with AI proved to be the most surprising aspect of the project: the ability to share ideas and receive increasingly relevant and stimulating suggestions transformed the methodological approach, favoring design over immediate development. Preventive analysis of complex scenarios enabled a significant reduction in overall project time, avoiding the improvised approach typical of "vibe coding" that often leads to dead ends or unsatisfactory solutions. AI Copilot proved to be a valuable assistant, while the mobile application became an almost indispensable tool for sketching ideas to develop later or conducting in-depth research in real-time.
LaTeX-style Typesetting: Copilot suggested an academic-level typesetting inspired by LaTeX, featuring justified text with automatic hyphenation. The layout employs the open-source font Crimson Pro, widely used in scientific and editorial publications for its elegance and readability.
AI Code Production
An aspect that deserves specific reflection in my experience is the use of AI for code generation. The initial approach I had attempted, based on "block" methods like vibe code, proved inefficient: too much redundant code, technical and functional anomalies, and revision time often exceeding that necessary to write code manually.
The best practice I developed: The most effective method remains the "old school" one: start from detailed analysis and clear requirements. The more precise the requirement I provide, the more the code generated by AI aligns with my expectations.
I identified a recurring flaw of "amnesias" due to token limits in responses and, especially, the fact that models, having limited memory, tend to deliberately discard content deemed less relevant. When subsequently requested, this content is often reinvented or presented through superficial summaries, generating frequent errors and inconsistencies. This limitation makes constant and careful supervision of all AI-generated outputs indispensable.
The personal dimension of my project
On a personal level, I developed the project mainly during nighttime hours, after putting my daughter to bed. My wife had established an absolute ban on touching the PC after dinner, so I started intensively using the Copilot mobile app to design and develop ideas. This "suspicious" behavior with the smartphone made her suspicious to the point of checking on me, convinced I had a digital lover! The irony is that, in a certain sense, she was right: my relationship with AI had become quite intense. Despite these amusing domestic obstacles, seeing a complex and functional system take shape day by day, born from a casual idea in the mountains, proved extremely satisfying and made every nighttime sacrifice definitely worth it.
The software development part also presented its challenges in my experience. Adopting Blazor Server and .NET 10 as framework, initially difficult due to my limited familiarity and the fact that this version had broken compatibility with some previous patterns (creating considerable confusion), transformed over time into a strength. Consistency with the .NET ecosystem and the ability to naturally integrate complex functionality proved to be valuable characteristics that more than compensated for initial difficulties.
Towards a replicable model: The New Frontiers of MantoX Blog 2
In conclusion, this experience has reinforced a conviction: the hybrid model, where AI is used in a targeted and non-totalizing way, can be the key to integrating artificial intelligence into business and creative processes. It's not about "doing everything with AI," but using it where it really serves, preserving human control at critical points.
Latest innovations integrated into the platform (MantoX Blog 2):
- π Trend Radar with Donut Chart & Timeframe Switcher: Exact 100% cluster coverage with 0ms dynamic switching across 7 Days, 1 Month, 3 Months, 1 Year, or Entire Archive.
- π GEO & LLMO Standards (
/llms.txt&/llms-full.txt): Native structured Markdown endpoints for Generative Search Engines (ChatGPT Search, Perplexity, Gemini). - π·οΈ Schema.org JSON-LD Structured Data: Graph containing
NewsArticle, podcastAudioObject, andFAQPagefor Smart Q&A cards. - π Clean RESTful URLs & In-Memory State: Clean canonical routes for categories (
/news/category/...) and topics (/news/topic/...) with in-memory filter persistence and zero bulky query strings. - ποΈ Bilingual HD Azure Speech TTS: English neural voice
en-US-AndrewMultilingualNeuralwith backfill batching and English radio host intro generation.
