enum GlueVersion 🔹

Language	Type name
.NET	Amazon.CDK.AWS.Glue.Alpha.GlueVersion
Go	github.com/aws/aws-cdk-go/awscdkgluealpha/v2#GlueVersion
Java	software.amazon.awscdk.services.glue.alpha.GlueVersion
Python	aws_cdk.aws_glue_alpha.GlueVersion
TypeScript (source)	@aws-cdk/aws-glue-alpha » GlueVersion

AWS Glue version determines the versions of Apache Spark and Python that are available to the job.

See also: https://docs.aws.amazon.com/glue/latest/dg/add-job.html.

Example

import * as cdk from 'aws-cdk-lib';
import * as iam from 'aws-cdk-lib/aws-iam';
declare const stack: cdk.Stack;
declare const role: iam.IRole;
declare const script: glue.Code;
new glue.PySparkEtlJob(stack, 'PySparkETLJob', {
  jobName: 'PySparkETLJobCustomName',
  description: 'This is a description',
  role,
  script,
  glueVersion: glue.GlueVersion.V3_0,
  continuousLogging: { enabled: false },
  workerType: glue.WorkerType.G_2X,
  maxConcurrentRuns: 100,
  timeout: cdk.Duration.hours(2),
  connections: [glue.Connection.fromConnectionName(stack, 'Connection', 'connectionName')],
  securityConfiguration: glue.SecurityConfiguration.fromSecurityConfigurationName(stack, 'SecurityConfig', 'securityConfigName'),
  tags: {
    FirstTagName: 'FirstTagValue',
    SecondTagName: 'SecondTagValue',
    XTagName: 'XTagValue',
  },
  numberOfWorkers: 2,
  maxRetries: 2,
});

Members

Name	Description
V0_9 🔹	Glue version using Spark 2.2.1 and Python 2.7.
V1_0 🔹	Glue version using Spark 2.4.3, Python 2.7 and Python 3.6.
V2_0 🔹	Glue version using Spark 2.4.3 and Python 3.7.
V3_0 🔹	Glue version using Spark 3.1.1 and Python 3.7.
V4_0 🔹	Glue version using Spark 3.3.0 and Python 3.10.
V5_0 🔹	Glue version using Spark 3.5.2 and Python 3.11.

---

V0_9 🔹

Glue version using Spark 2.2.1 and Python 2.7.

---

V1_0 🔹

Glue version using Spark 2.4.3, Python 2.7 and Python 3.6.

---

V2_0 🔹

Glue version using Spark 2.4.3 and Python 3.7.

---

V3_0 🔹

Glue version using Spark 3.1.1 and Python 3.7.

---

V4_0 🔹

Glue version using Spark 3.3.0 and Python 3.10.

---

V5_0 🔹

Glue version using Spark 3.5.2 and Python 3.11.