feat: add changelogs and update links (#160)

* add changelogs and update links

* twitter rebranding

* add 0-11 changelog

* add apache flink

* fix link

* add changelog for 0-10

* fix broken links

* remove repeated blocks

* add http connector changelog

* update installing and add changelog link

* remove latest

* rename links

* add processors changelog

* show more than 5 changelogs

* a bit more room

* add 0.8.0 release

* add 0.7.0 release

* add changelog for 0.6.0

* add and updates all blog posts

* fix header

* address feedback

---------

Co-authored-by: Haris Osmanagić <[email protected]>

changelog/2022-01-21-conduit-0-1-0-release.md

@@ -0,0 +1,38 @@
+---
+slug: '2022-01-21-conduit-0-1-0-release'
+title: Conduit 0.1.0 release
+draft: false
+tags: [conduit, release]
+---
+
+[**Conduit** is now open-sourced](https://github.com/ConduitIO/conduit/releases/tag/v0.1.0)! Designed to simplify data integration for software engineers, Conduit provides a flexible and developer-friendly solution for streaming data orchestration.
+
+<!--truncate-->
+
+### Key Features
+
+- **Easy Setup**: Get started quickly by downloading the Conduit binary, unzipping it, and building pipelines. Simply run the following commands:
+
+```bash
+$ tar zxvf conduit_0.1.0_Darwin_x86_64.tar.gz
+$ ./conduit
+```
+
+- **User Interface**: Conduit includes a built-in UI for local development, allowing you to easily navigate to [http://localhost:8080/ui/](http://localhost:8080/ui/) and start building pipelines.
+- **Developer-Centric Design**: Conduit aims to provide an excellent experience for connector developers, ensuring consistency and familiarity with modern programming practices.
+- **Open Source**: Conduit is open-sourced with a permissive license, promoting accessibility for all developers.
+
+### Use Cases
+
+With Conduit, you can build pipelines to move data between various sources, including:
+- Kafka to Postgres
+- File to Kafka
+- File to File
+- PostgreSQL to Postgres
+- PostgreSQL to Amazon S3
+
+As we continue to expand our connector offerings, we encourage you to explore these use cases and share your ideas with us!
+
+:::tip
+For more information on getting started with Conduit, visit our [GitHub releases page](https://github.com/meroxa/conduit/releases). To read more, check out [our blog post](https://meroxa.com/blog/conduit-streaming-data-integration-for-developers/).
+:::

changelog/2022-04-04-conduit-0-2-0-release.md

@@ -0,0 +1,20 @@
+---
+slug: '2022-04-04-conduit-0-2-0-release'
+title: Conduit 0.2.0 release
+draft: false
+tags: [conduit, release]
+---
+
+[**Conduit v0.2**](https://github.com/ConduitIO/conduit/releases/tag/v0.2.0) is now available. This release enhances Conduit's capabilities for data movement across various systems and simplifies the transition from legacy systems.
+
+<!--truncate-->
+
+### What’s New
+
+- **Official SDK for Connectors**: Developers can now build connectors for any data store using the new Conduit Connector SDK, making it easier to support diverse production environments.
+- **Kafka Connect Integration**: Conduit 0.2 allows you to leverage existing Kafka Connect connectors, enabling a smooth transition to Conduit while minimizing downtime and impact on downstream systems.
+-  **Simplified Connector Lifecycle**: The SDK simplifies connector implementation, requiring only four functions to create a fully functional connector. This design goal aims to make building connectors straightforward and efficient.
+
+:::tip
+For more details on the new features in Conduit v0.2, check out our [blog post](https://meroxa.com/blog/conduit-0.2-making-connectors-a-reality/).
+:::

changelog/2022-09-27-conduit-0-3-0-release.md

@@ -0,0 +1,20 @@
+---
+slug: '2022-09-27-conduit-0-3-0-release'
+title: Conduit 0.3.0 release
+draft: false
+tags: [conduit, release]
+---
+
+[**Conduit v0.3**](https://github.com/ConduitIO/conduit/releases/tag/v0.3.0) is ready for use, and this release enhances the tool's capabilities for moving data within your infrastructure.
+
+<!--truncate-->
+
+### What’s New
+
+- **OpenCDC Support**: Conduit now supports OpenCDC, providing consistent payload formats for Change Data Capture (CDC) across connectors. Note that this introduces a breaking change in the Connector SDK; connectors not updated for v0.3 will only work with v0.2.
+- **Pipeline Configuration File**: You can now configure pipelines using a static YAML file, making it easier to manage and version control your pipeline configurations.
+- **JavaScript Processors**: Transform data using JavaScript to handle tasks like removing personally identifiable information before it reaches downstream systems. This feature allows for the injection of processors at various points in the pipeline.
+
+:::tip
+For more details on the new features in Conduit v0.3, check out our [blog post](https://meroxa.com/blog/conduit-0.3/).
+:::

changelog/2022-12-15-conduit-0-4-0-release.md

@@ -0,0 +1,20 @@
+---
+slug: '2022-12-15-conduit-0-4-0-release'
+title: Conduit 0.4.0 release
+draft: false
+tags: [conduit, release]
+---
+
+[**Conduit v0.4**](https://github.com/ConduitIO/conduit/releases/tag/v0.4.0) is out now. This release enhances error handling and debugging capabilities for developers building streaming data pipelines.
+
+<!--truncate-->
+
+### Key Features
+
+-  **Stream Inspector**: Inspect data as it enters Conduit through source connectors and observe its journey to destination connectors. This feature helps in debugging by providing visibility into data flow.
+-  **Dead Letter Queues (DLQs)**: Configure DLQs to redirect messages that fail processing to another connector for further handling. This allows for better management of erroneous data.
+-  **Connector Parameter Validation**: Developers can now define required parameters for connectors, enabling Conduit to provide clearer error messages and streamline the setup process.
+
+:::tip
+For more details on the new features in Conduit v0.4, check out our [blog post](https://meroxa.com/blog/conduit-0.4/).
+:::

changelog/2023-02-28-conduit-0-5-0-release.md

@@ -0,0 +1,25 @@
+---
+slug: '2023-02-28-conduit-0-5-0-release'
+title: Conduit 0.5.0 release
+draft: false
+tags: [conduit, release]
+---
+
+[**Conduit v0.5**](https://github.com/ConduitIO/conduit/releases/tag/v0.5.0) is out! This release focuses on making Conduit easier to operate as a service, with enhancements aimed at improving usability and functionality for developers building streaming data pipelines.
+
+<!--truncate-->
+
+
+### Key Enhancements
+
+- **Stream Inspector**: Enhanced to allow inspection of data as it enters or leaves processors, providing better visibility into data flow.
+- **Dead Letter Queues (DLQs)**: DLQ configuration is now accessible via HTTP and gRPC APIs, along with new metrics to monitor DLQ behavior.
+- **New Processors**:
+  - **Parse Json Processor**: Converts raw JSON data into structured data.
+  - **Unwrap Processor**: Unwraps records from payloads for both Debezium and Kafka Connect formats.
+- **Health Check**: A new health check endpoint to verify Conduit’s operational status and connectivity to configured databases.
+
+
+:::tip
+For a deeper dive into the new features and enhancements in Conduit v0.5, check out our [blog post](https://meroxa.com/blog/conduit-0.5/).
+:::

changelog/2023-04-11-conduit-0-6-0-release.md

@@ -0,0 +1,25 @@
+---
+slug: '2023-04-11-conduit-0-6-0-release'
+title: Conduit 0.6.0 release
+draft: false
+tags: [conduit, release]
+---
+
+[**Conduit v0.6**](https://github.com/ConduitIO/conduit/releases/tag/v0.6.0) is now available, bringing a range of new features and improvements designed to enhance your data integration capabilities. This version focuses on providing users with more flexibility and efficiency in managing their data pipelines.
+
+<!--truncate-->
+
+### Key Features
+
+- **Multiple Installation Options**: Conduit can now be installed via Homebrew, RPM, and Debian Packages.
+- **Expanded Connector Lifecycle Events**: New events include Source OnCreate, OnUpdate, OnDelete, and Destination OnCreate, OnUpdate, OnDelete, providing greater control over connector behavior.
+- **Parallel Processors**: Processors can now handle records concurrently. Specify the number of worker threads in your pipeline configuration for improved performance.
+- **Simplified Configuration:** Enjoy a more straightforward setup process for your data pipelines.
+
+### Looking Ahead to 1.0
+
+We aim to ensure Conduit operates reliably without major breaking changes as we approach the 1.0 release. We're also developing a Conduit Kubernetes Operator to simplify service management in production environments.
+
+:::tip
+For an in-depth look at the new features and improvements in Conduit v0.6, check out our [blog post](https://meroxa.com/blog/conduit-0.6/).
+:::

changelog/2023-07-19-conduit-0-7-0-release.md

@@ -0,0 +1,19 @@
+---
+slug: '2023-07-19-conduit-0-7-0-release'
+title: Conduit 0.7.0 release
+draft: false
+tags: [conduit, release]
+---
+
+[**Conduit v0.7**](https://github.com/ConduitIO/conduit/releases/tag/v0.7.0) has a new release! We continue to enhance Conduit as a powerful alternative to Kafka Connect, moving closer to our goal of supporting elaborate data pipelines.
+
+<!--truncate-->
+
+### Key Highlights
+
+- **Native Schema Registry Support**: This release enhances Conduit with native support for the Confluent Schema Registry, enabling you to encode and decode records using Avro schemas. This functionality allows you to store metadata about the data flowing through your pipelines, ensuring that data types and required fields are enforced, which boosts confidence in the integrity of the processed data. You can interact with the schema registry through four built-in processors: Decode with Schema Key, Decode with Schema Payload, Encode with Schema Key, and Encode with Schema Payload. Future updates will include support for additional formats like Protobuf and JSON schema.
+- **gRPC Connector**: We are excited to introduce gRPC Server and Client connectors, enabling Conduit to operate in distributed environments. This allows data to be aggregated in one location and forwarded to another, facilitating data movement across regions.
+
+:::tip
+For an in-depth look at the new features and improvements in Conduit v0.7, check out our [blog post](https://meroxa.com/blog/conduit-0.7-is-here).
+:::

changelog/2023-11-15-conduit-0-8-0-release.md

@@ -0,0 +1,26 @@
+---
+slug: '2023-11-15-conduit-0-8-0-release'
+title: Conduit 0.8.0 release
+draft: false
+tags: [conduit, release]
+---
+
+
+We're excited to announce a new release of [**Conduit v0.8**](https://github.com/ConduitIO/conduit/releases/tag/v0.8.0)! This update prioritizes performance enhancements, aiming to establish Conduit as the default tool for data movement. 
+
+<!--truncate-->
+
+### Key Highlights
+
+- **Performance Boost**: We’ve achieved a performance increase of over 2.5x, reaching nearly 70k messages per second through a single Kafka-to-Kafka pipeline. This improvement results from optimizations in the core of Conduit and enhancements to our Kafka Connector.
+
+### Future Work
+
+While we've made significant strides in performance, we are exploring further improvements, particularly in **micro-batching**. This technique combines multiple records into a single batch for processing, allowing us to push nearly 250k messages per second through a single pipeline. This experimental work demonstrates the potential for even greater performance gains.
+
+For those interested, the experimental micro-batching work is available in a branch of the Conduit repository.
+
+:::tip
+For an in-depth look at the new features and improvements in Conduit v0.8, check out our [blog post](https://meroxa.com/blog/conduit-0.8-is-here/).
+:::
+

changelog/2024-03-24-conduit-0-9-0-release.md

@@ -0,0 +1,23 @@
+---
+slug: '2024-03-24-conduit-0-9-0-release'
+title: Conduit 0.9.0 release
+draft: false
+tags: [conduit, release]
+---
+
+Revolutionize your data processing with [**Conduit v0.9**](https://github.com/ConduitIO/conduit/releases/tag/v0.9.0), featuring **enhanced processors**. This release introduces powerful new capabilities that allow you to transform and manage your data more effectively.
+
+<!--truncate-->
+
+### Key Highlights
+
+- **Introduction of Standalone Processors**: Conduit 0.9 allows developers to create custom processors using Web Assembly (WASM), enabling flexibility in data processing with modern programming languages.
+- **Enhanced Processor Framework**: The overhaul of the processor framework improves usability, allowing for more powerful and user-friendly data manipulation compared to previous versions.
+- **Comprehensive Documentation**: Detailed guides are provided for implementing standalone processors, including a "How it works" guide to assist developers in leveraging the new capabilities effectively.
+- **Improvements to Built-in Processors**: Significant enhancements have been made to existing built-in processors, making them more robust and easier to use for various data processing tasks.
+- **Dynamic Configuration**: The new connector SDK supports dynamic configuration parameters, allowing for more flexible and scalable pipeline setups.
+- **Getting Started Guide**: A user-friendly guide is available to help new users set up Conduit and explore the latest features quickly.
+
+:::tip
+For an in-depth look at how the enhanced processors can transform your data processing workflows, check out our [blog post](https://meroxa.com/blog/introducing-conduit-0.9-revolutionizing-data-processing-with-enhanced-processors/), and visit our [Processors documentation page](/docs/processors).
+:::

changelog/2024-04-13-http-connector.md

@@ -0,0 +1,21 @@
+---
+slug: '2024-04-13-http-connector'
+title: Conduit HTTP Connector
+draft: false
+tags: [conduit, connector, http]
+---
+
+Enhance your data integration capabilities with the **new HTTP connector for Conduit**. This connector is designed to simplify the process of connecting to HTTP-based data sources and destinations, making your data flow more efficient. This HTTP Connector serves as a gateway to integrate a wide range of web services and APIs into your data pipelines, streamlining data workflows and enhancing efficiency.
+
+<!--truncate-->
+
+### Key Highlights
+
+- **Generic HTTP Connector**: Connect to any HTTP-based service or API, allowing seamless data transfer between Conduit source connectors and HTTP endpoints.
+- **Easy Setup**: Build and test the HTTP Connector effortlessly by downloading the release binary or compiling from source. 
+- **Source Connector**: Pull data from HTTP APIs with customizable configurations, including request methods, headers, and polling intervals.
+- **Destination Connector**: Push processed data to specified HTTP endpoints using flexible request methods (POST, PUT, DELETE, PATCH) for integration with various APIs.
+
+:::tip
+For an in-depth look at how the new HTTP connector can enhance your data integration, check out our [blog post](https://meroxa.com/blog/introducing-the-new-http-connector-for-conduit-streamline-your-data-flow/), and visit our [Conduit HTTP Connector GitHub page](https://github.com/conduitio-labs/conduit-connector-http)
+:::

changelog/2024-04-30-conduit-0-10-0-release.md

@@ -0,0 +1,23 @@
+---
+slug: '2024-04-30-conduit-0-10-0-release'
+title: Conduit 0.10.0 release
+draft: false
+tags: [conduit, release]
+---
+
+[**Conduit v0.10**](https://github.com/ConduitIO/conduit/releases/tag/v0.10.0) is here! This release introduces **native support for multiple collections**, addressing user feedback and enhancing the flexibility of data integration.
+
+<!--truncate-->
+
+### Key Highlights
+
+- **Multiple Collections Support**: Connect and integrate multiple data collections simultaneously, improving scalability and simplifying pipeline management. Collections can refer to tables in databases, topics in Kafka, or indices in Elasticsearch.
+- **Kafka Connector Enhancements**: The Kafka connector now supports reading from and writing to multiple topics. You can configure it to route records based on the `opencdc.collection` metadata field.
+- **Postgres Connector Improvements**: The Postgres connector can now read from multiple tables, including support for wildcard options to capture all tables in a public schema. This feature simplifies initial data ingestion and schema changes.
+- **Generator Connector Updates**: The generator connector can emit records with different formats, simulating multiple collections in a single configuration.
+- **Dynamic Configuration Parameters**: Introduced dynamic parameters in connectors, allowing for more flexible configurations using wildcards.
+
+
+:::tip
+For an in-depth look at how multiple collections support can enhance your data integration, check out our [blog post](https://meroxa.com/blog/conduit-0.10-comes-with-multiple-collections-support/).
+:::

changelog/2024-06-17-connector-for-apache-flink.md

@@ -0,0 +1,19 @@
+---
+slug: '2024-06-17-connector-for-apache-flink'
+title: Conduit Connector for Apache Flink
+draft: false
+tags: [conduit, connector, flink]
+---
+
+We’re pleased to announce **Meroxa's new Conduit connector for Apache Flink**! This powerful connector enables seamless integration between Flink and various data sources and destinations, enhancing your data streaming capabilities.
+
+<!--truncate-->
+
+### Key Highlights
+
+- **Real-Time Data Processing:** Leverage Flink’s capabilities for real-time data processing and analytics.
+- **Easy Integration:** Quickly connect to multiple data sources and destinations with minimal configuration.
+
+:::tip
+For an in-depth look at how to get started with the new Conduit connector for Apache Flink, check out our [blog post](https://meroxa.com/blog/introduction-to-meroxa's-new-conduit-connector-for-apache-flink/), and visit our [Conduit Flink Connector GitHub page](https://github.com/conduitio-labs/conduit-flink-connector).
+:::

changelog/2024-08-19-conduit-0-11-0-release.md

@@ -0,0 +1,20 @@
+---
+slug: '2024-08-19-conduit-0-11-0-release'
+title: Conduit 0.11.0 release
+draft: false
+tags: [conduit, release]
+---
+
+We’re thrilled to announce the release of [**Conduit v0.11**](https://github.com/ConduitIO/conduit/releases/tag/v0.11.0), featuring **enhanced schema support** for improved data integration! This update empowers users to manage and transform data more effectively across various sources and destinations.
+
+<!--truncate-->
+
+### Key Highlights
+
+- **Dynamic Schema Handling:** Automatically adapt to changes in data structure, ensuring seamless integration.
+- **Schema Validation:** Validate incoming data against defined schemas to maintain data integrity.
+- **Enhanced Transformation Capabilities:** Easily transform data as it flows through your pipelines, making integration smoother and more efficient.
+
+:::tip
+For an in-depth look at how these new features can elevate your data integration processes, check out our [blog post](https://meroxa.com/blog/conduit-v0.11-unveils-powerful-schema-support-for-enhanced-data-integration/), our [Schema Support documentation page](/docs/features/schema-support).
+:::

changelog/2024-10-10-conduit-0-12-0-release.md

@@ -0,0 +1,20 @@
+---
+slug: '2024-10-10-conduit-0-12-0-release'
+title: Conduit 0.12.0 release
+draft: false
+tags: [conduit, release]
+---
+
+We’re excited to announce the release of [**Conduit v0.12.0**](https://github.com/ConduitIO/conduit/releases/tag/v0.12.0), which introduces **Pipeline Recovery**! This new feature enhances the resilience of your data streaming pipelines, ensuring they can recover from temporary errors without manual intervention.
+
+<!--truncate-->
+
+### Key Highlights
+
+-  **Automatic Pipeline Restart:** Pipelines that encounter errors will now automatically restart, using a smart backoff algorithm to manage retries.
+-  **Configurable Backoff Settings:** Customize the backoff parameters through CLI flags, environment variables, or a global configuration file.
+-  **Smart Retry Management:** Limits on retries prevent indefinite restarts, keeping your pipelines efficient and reliable.
+
+:::tip
+For a detailed overview of how Pipeline Recovery works and its benefits, check out our [blog post](https://meroxa.com/blog/unlocking-resilience:-conduit-v0.12.0-introduces-pipeline-recovery/), or our documentation for [Pipeline Recovery](/docs/features/pipeline-recovery) and learn how to make your data streaming experience smoother than ever!
+:::