Posted on March 15, 2023 AWS Glue – An error occurred while calling o199.pyWriteDataFrame. Cannot find catalog plugin class for catalog ‘glue_catalog’: org.apache.iceberg.spark.SparkCatalog
Posted on February 17, 2023February 14, 2023 An error occurred while calling o177.pyWriteDynamicFrame. Schema cannot be updated: data type has been changed, new data type: [column] optional int32 column (DECIMAL(4,2)) does not match old data type: [column] optional int32 column (DECIMAL(3,2))
Posted on February 1, 2023January 27, 2023 AWS Glue – An error occurred while calling o93.getDynamicFrame. No such file or directory s3 parquet
Posted on January 27, 2023February 1, 2023 AWS Glue – createJob: Access DeniedException Account is denied access
Posted on August 23, 2020August 23, 2020 2.1 Billion Taxi Rides using Alibaba Cloud AnalyticDB for MySQL
Data Engineering Learnings 