Posts

Showing posts from May, 2025

Kafka key Thing with Schema Validation

Image
  Producer   Consumer :   https://www.confluent.io/blog/how-schema-registry-clients-work/ https://medium.com/data-arena/schema-evolution-with-schema-registry-8d601ee84f4b

Docker

Image
  Docker Compose  a. What is Docker Compose? Docker Compose  is a  YAML file  where you define how multiple containers work together (services, volumes, networks). b. docker-compose.yml Basics services : Your app containers. volumes : Persistent storage. ports : Port mappings (host:container). networks : Group containers for communication. c. Hands-on Example docker-compose.yml Example 1  (Kafka) version: '3.8' services: kafka-broker: image: confluentinc/cp-kafka:latest container_name: kafka-broker hostname: kafka-broker ports: - "9092:9092" - "19092:19092" environment: KAFKA_BROKER_ID: 1 KAFKA_LISTENER_SECURITY_PROTOCOL_MAP: PLAINTEXT:PLAINTEXT,PLAINTEXT_INTERNAL:PLAINTEXT,CONTROLLER:PLAINTEXT KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://kafka-broker:19092,PLAINTEXT_INTERNAL://localhost:9092 KAFKA_OFFSETS_TOPIC_REPLICATION_FACTOR: 1 KAFKA_GROUP_INITIAL_REBALANCE_DELAY_MS: 0 KAFKA_TRANSACTION...