For updates follow Ian on LinkedIn and (Twitter)
logo
ManaGen🔮AI
Formatting
Initializing search
    genai
    • Understand and build
    • Use and Manage
    • Managen.ai
    • Blog
    genai
    • Understand and build
      • Overview
        • Use cases
        • Challenges
        • Chronology
        • Ai and ml basics
        • Open source
        • Philosophies
        • Background
          • Tensor maths
        • Extra resources
      • Data
        • Preparation
          • Collection
          • Selection
          • Augmentation
        • Tokenizing
        • Privacy
        • Sources
        • Distillation
      • Architectures
        • Models
          • Transformers
          • Multimodal
          • Diffusion models
          • Developing architectures
          • Gans
          • Hybrid models
          • Mixture of experts
          • Reinforcement learning
          • Vision language transformers
        • Training
          • Pre training
          • Finetuning
          • Feedback
          • Recursive
          • Distributed
          • Grounding
          • Online
        • Gpt
        • Optimization
        • Evaluating and comparing
        • Embedding
        • Frameworks
        • Generation
      • Prompting
        • Auto prompting
        • Hacking
        • Prompt compression
        • Security
        • Tools and libraries
            • Claude 2024 07 20
            • Claude 2024 07 11
      • Agents
        • Examples
        • Cognitive architecture
        • Retrieval-Augmented Generation (RAG)
        • Memory
        • Knowledge Graphs: Empowering Large Language Models with Structured Knowledge
        • Actions and tools
        • Evaluating and comparing
        • Environments
        • Systems
        • Applications
        • Commercial
        • Behavior
        • Studies
      • Building
        • Training and finetuning
        • Pre trained models
        • Back end
        • Front end
        • Agents
        • Platforms
        • Compliance
        • Computation
        • Data
        • Examples and tutorials
        • Deploying Libraries and Tools
        • Memory
        • Model serving
        • Orchestrating
    • Use and Manage
      • Strategically
        • Building or buying
        • Business models
        • Implementation
        • Open source
      • Ethically
        • Alignment and existential concerns
        • Confabulation
        • Dual use concerns
        • Fairness
        • Transparency
      • Managing
        • Governing
        • Ml ops
        • Observability
        • Regulations and guidelines
      • Tech stack
      • De risking
        • Explainability
        • Marking and detecting
        • Red Teaming in AI
        • Security
      • Useful tools
        • Integrations
        • Web plugins
      • Examples
        • By field
          • Business
            • Movies and Video
            • Static
          • Science
            • Chemistry
            • Healthcare
            • Biology
              • Genetics
              • Protein Optimization Using AI
          • Mathematics
            • Education
            • Law
            • Socio societal
            • Chip design
            • Coding
            • Drug design
            • Finance
            • Healthcare
            • Robotics
        • By modality
          • Charts and graphs
          • Knowledge graphs
          • Language
          • Multimodal
          • Sound
          • Static 2d
          • Tabular
          • Text
          • Time series
          • Video
          • Chat
          • Content framing
          • Data extraction
          • Forecasting
          • Planning
          • Recommender systems
          • Research
          • Web crawling
    • Managen.ai
      • Build plan
      • Project requirements
      • Brainstorming
      • Contributing to GenAI 🌟
      • Code of Conduct
      • Site graph
      • Explorations blog
      • Strategy
    • Blog
        • Hello world!

    Formatting

    A very nice data preparation library to strip out unnecessary formatting in html for processing by LLMs

    https://github.com/romansky/dom-to-semantic-markdown

    Was this page helpful?
    Thanks for your feedback!
    Thanks for your feedback! Help us improve this page by using our feedback form.
    Previous
    Collection
    Next
    Selection
    Copyright © Ian Derrington; Change cookie settings

    Cookie consent

    We use cookies to recognize your repeated visits and preferences, as well as to measure the effectiveness of our documentation and whether users find what they're searching for. With your consent, you're helping us to make our documentation better.