使用Terraform开启和关闭RDS PostgreSQL的SQL审计

通过Terraform工具,可以用代码的方式来管理和维护RDS PostgreSQL实例。本文介绍如何使用Terraform开启和关闭SQL审计,以获取数据库实例SQL语句的具体信息,排查各种性能问题。

说明

本教程所含示例代码支持一键运行,您可以直接运行代码。一键运行

前提条件

  • 已创建RDS PostgreSQL实例,详情请参见创建RDS PostgreSQL实例

  • 实例状态为运行中,您可以通过如下两种方式查看:

    • 参见查询实例详情查看参数status,如果取值为Running则表示实例状态为运行中。

    • 前往RDS管理控制台,切换到目标地域,找到指定实例后,查看实例状态。

  • 由于阿里云账号(主账号)具有资源的所有权限,一旦发生泄露将面临重大风险。建议您使用RAM用户,并为该RAM用户创建AccessKey,具体操作方式请参见创建RAM用户创建AccessKey

  • 通过RAM授权,RAM用户可以有效地管理其云资源访问权限,适应多用户协同工作的需求,并且能够按需为用户分配最小权限,避免权限过大导致的安全漏洞。具体操作方式请参见为RAM用户授权

    {
        "Version": "1",
        "Statement": [
            {
                "Effect": "Allow",
                "Action": [
                    "vpc:DescribeVpcAttribute",
                    "vpc:DescribeRouteTableList",
                    "vpc:DescribeVSwitchAttributes",
                    "vpc:DeleteVpc",
                    "vpc:DeleteVSwitch",
                    "vpc:CreateVpc",
                    "vpc:CreateVSwitch"
                ],
                "Resource": "*"
            },
            {
                "Action": "rds:*",
                "Resource": "*",
                "Effect": "Allow"
            },
            {
                "Action": "dbs:*",
                "Resource": "acs:rds:*:*:*",
                "Effect": "Allow"
            },
            {
                "Action": "hdm:*",
                "Resource": "acs:rds:*:*:*",
                "Effect": "Allow"
            },
            {
                "Action": "dms:LoginDatabase",
                "Resource": "acs:rds:*:*:*",
                "Effect": "Allow"
            },
            {
                "Effect": "Allow",
                "Action": "ram:CreateServiceLinkedRole",
                "Resource": "*",
                "Condition": {
                    "StringEquals": {
                        "ram:ServiceName": [
                            "backupencryption.rds.aliyuncs.com"
                        ]
                    }
                }
            },
            {
                "Effect": "Allow",
                "Action": "bss:ModifyAgreementRecord",
                "Resource": "*"
            },
            {
                "Effect": "Allow",
                "Action": [
                    "bss:DescribeOrderList",
                    "bss:DescribeOrderDetail",
                    "bss:PayOrder",
                    "bss:CancelOrder"
                ],
                "Resource": "*"
            }
        ]
    }
  • 准备Terraform运行环境,您可以选择以下任一方式来使用Terraform。

    • 在Terraform Explorer中使用Terraform:阿里云提供了Terraform的在线运行环境,您无需安装Terraform,登录后即可在线使用和体验Terraform。适用于零成本、快速、便捷地体验和调试Terraform的场景。

    • Cloud Shell:阿里云Cloud Shell中预装了Terraform的组件,并已配置好身份凭证,您可直接在Cloud Shell中运行Terraform的命令。适用于低成本、快速、便捷地访问和使用Terraform的场景。

    • 在本地安装和配置Terraform:适用于网络连接较差或需要自定义开发环境的场景。

使用的资源

说明

本教程示例包含的部分资源会产生一定费用,请在不需要时及时进行释放或退订。

开启SQL审计

  1. 创建一个工作目录,并在该工作目录中创建名为main.tf的配置文件,然后将以下代码复制到main.tf中。

    • 创建前置资源。

      variable "region" {
        default = "cn-shenzhen"
      }
      
      variable "zone_id" {
        default = "cn-shenzhen-c"
      }
      
      variable "instance_type" {
        default = "pg.n2.2c.2m"
      }
      
      provider "alicloud" {
        region = var.region
      }
      
      # 创建VPC
      resource "alicloud_vpc" "main" {
        vpc_name   = "alicloud"
        cidr_block = "172.16.0.0/16"
      }
      
      # 创建交换机
      resource "alicloud_vswitch" "main" {
        vpc_id     = alicloud_vpc.main.id
        cidr_block = "172.16.192.0/20"
        zone_id    = var.zone_id
      }
      
      # 创建RDS PostgreSQL实例
      resource "alicloud_db_instance" "instance" {
        engine               = "PostgreSQL"
        engine_version       = "13.0"
        instance_type        = var.instance_type
        instance_storage     = "30"
        instance_charge_type = "Postpaid"
        vswitch_id           = alicloud_vswitch.main.id
      }                    
    • main.tf文件的resource "alicloud_db_instance" "instance" {}中增加sql_collector_status配置项,具体配置如下。

      ...
      resource "alicloud_db_instance" "instance" {
      ...
        sql_collector_status = "Enabled"
      } 
  2. 执行以下命令,初始化Terraform运行环境。

    terraform init

    返回如下信息,表示Terraform初始化成功。

    Initializing the backend...
    
    Initializing provider plugins...
    - Checking for available provider plugins...
    - Downloading plugin for provider "alicloud" (hashicorp/alicloud) 1.90.1...
    ...
    
    You may now begin working with Terraform. Try running "terraform plan" to see
    any changes that are required for your infrastructure. All Terraform commands
    should now work.
    
    If you ever set or change modules or backend configuration for Terraform,
    rerun this command to reinitialize your working directory. If you forget, other
    commands will detect it and remind you to do so if necessary.
  3. 创建执行计划,并预览变更。

    terraform plan
  4. 执行以下命令,创建资源。

    terraform apply

    在执行过程中,根据提示输入yes并按下Enter键,等待命令执行完成,若出现以下信息,则表示运行成功。

    alicloud_db_instance.instance: Modifying... [id=pgm-****]
    alicloud_db_instance.instance: Still modifying... [id=pgm-****, 10s elapsed]
    alicloud_db_instance.instance: Still modifying... [id=pgm-****, 20s elapsed]
    ...
    alicloud_db_instance.instance: Still modifying... [id=pgm-****, 3m0s elapsed]
    alicloud_db_instance.instance: Modifications complete after 3m4s [id=pgm-****]
    
    Apply complete! Resources: 0 added, 1 changed, 0 destroyed.
  5. 验证结果。

    执行terraform show命令

    您可以使用以下命令查看SQL审计状态。

    terraform show
    # alicloud_db_instance.instance:
    resource "alicloud_db_instance" "instance" {
        acl                        = "prefer"
        ca_type                    = "aliyun"
        client_ca_enabled          = 0
        client_crl_enabled         = 0
        connection_string          = "pgm-****.pg.rds.aliyuncs.com"
        connection_string_prefix   = "pgm-****"
        db_instance_storage_type   = "cloud_essd"
        db_time_zone               = "Asia/Shanghai"
        deletion_protection        = false
        engine                     = "PostgreSQL"
        engine_version             = "13.0"
        force_restart              = false
        ha_config                  = "Manual"
        id                         = "pgm-****"
        instance_charge_type       = "Postpaid"
        instance_name              = "terraformtest"
        instance_storage           = 50
        instance_type              = "pg.n2.2c.2m"
        maintain_time              = "05:00Z-06:00Z"
        manual_ha_time             = "2022-09-30T09:00:00Z"
        monitoring_period          = 300
        period                     = 0
        port                       = "5432"
        private_ip_address         = "192.168.XX.XX"
        replication_acl            = "prefer"
        resource_group_id          = "rg-****"
        security_group_id          = "sg-****"
        security_group_ids         = [
            "sg-bp1h9iqx6mxan5tcouwc",
        ]
        security_ip_mode           = "normal"
        security_ips               = [
            "0.0.0.0/0",
        ]
        server_cert                = <<-EOT
            -----BEGIN CERTIFICATE-----
            MIIE7jCCA9****fM4ALgBJ2
            N9xwKlPQ65q/kux0yErtwhAD
            -----END CERTIFICATE-----
        EOT
        server_key                 = <<-EOT
            -----BEGIN RSA PRIVATE KEY-----
            MIIJKQIBAA****T4Y1K34yE+e+VAdGp
            -----END RSA PRIVATE KEY-----
        EOT
        sql_collector_config_value = 30
        sql_collector_status       = "Enabled"
        ssl_action                 = "Open"
        ssl_status                 = "0"
        storage_auto_scale         = "Enable"
        storage_threshold          = 30
        storage_upper_bound        = 100
        target_minor_version       = "rds_postgres_1300_20220830"
        tcp_connection_type        = "SHORT"
        vpc_id                     = "vpc-****"
        vswitch_id                 = "vsw-****"
        zone_id                    = "cn-hangzhou-j"
    
        pg_hba_conf {
            address     = "127.0.0.1"
            database    = "all"
            method      = "md5"
            priority_id = 1
            type        = "host"
            user        = "all"
        }
    }

    登录RDS管理控制台

    登录RDS管理控制台查看SQL审计状态。开启SQL审计

关闭SQL审计

  1. 在上述main.tf文件的resource "alicloud_db_instance" "instance" {}中修改sql_collector_status配置项,具体配置如下。

    ...
    resource "alicloud_db_instance" "instance" {
    ...
      sql_collector_status = "Disabled"
    }               
  2. 执行以下命令。

    terraform apply

    在执行过程中,根据提示输入yes并按下Enter键,等待命令执行完成,若出现以下信息,则表示运行成功。

    alicloud_db_instance.instance: Modifying... [id=pgm-****]
    alicloud_db_instance.instance: Modifications complete after 9s [id=pgm-****]
    
    Apply complete! Resources: 0 added, 1 changed, 0 destroyed.
  3. 验证结果。

    执行terraform show命令

    您可以使用以下命令查看SQL审计状态。

    terraform show
    # alicloud_db_instance.instance:
    resource "alicloud_db_instance" "instance" {
        client_ca_enabled          = 0
        client_crl_enabled         = 0
        connection_string          = "pgm-****.pg.rds.aliyuncs.com"
        connection_string_prefix   = "pgm-***"
        db_instance_storage_type   = "cloud_essd"
        db_time_zone               = "Asia/Shanghai"
        deletion_protection        = false
        engine                     = "PostgreSQL"
        engine_version             = "13.0"
        force_restart              = false
        ha_config                  = "Auto"
        id                         = "pgm-****"
        instance_charge_type       = "Postpaid"
        instance_storage           = 30
        instance_type              = "pg.n2.2c.2m"
        maintain_time              = "18:00Z-22:00Z"
        monitoring_period          = 300
        period                     = 0
        port                       = "5432"
        private_ip_address         = "172.16.XX.XX"
        resource_group_id          = "rg-****"
        security_group_ids         = []
        security_ip_mode           = "normal"
        security_ips               = [
            "127.0.0.1",
        ]
        sql_collector_config_value = 30
        sql_collector_status       = "Disabled"
        storage_threshold          = 0
        storage_upper_bound        = 0
        target_minor_version       = "rds_postgres_1300_20220730"
        tcp_connection_type        = "LONG"
        vpc_id                     = "vpc-****"
        vswitch_id                 = "vsw-****"
        zone_id                    = "cn-hangzhou-j"
    }
    
    # alicloud_vpc.main:
    resource "alicloud_vpc" "main" {
        cidr_block            = "172.16.0.0/16"
        id                    = "vpc-****"
        name                  = "alicloud"
        resource_group_id     = "rg-****"
        route_table_id        = "vtb-****"
        router_id             = "vrt-****"
        router_table_id       = "vtb-****"
        secondary_cidr_blocks = []
        status                = "Available"
        vpc_name              = "alicloud"
    }
    
    # alicloud_vswitch.main:
    resource "alicloud_vswitch" "main" {
        availability_zone = "cn-hangzhou-j"
        cidr_block        = "172.16.192.0/20"
        id                = "vsw-****"
        status            = "Available"
        vpc_id            = "vpc-****"
        zone_id           = "cn-hangzhou-j"
    }

    登录RDS管理控制台

    登录RDS管理控制台查看SQL审计状态。关闭SQL审计

清理资源

当您不再需要上述通过Terraform创建或管理的资源时,请运行以下命令以释放资源。关于terraform destroy的更多信息,请参见Terraform常用命令

terraform destroy

完整示例

说明

当前示例代码支持一键运行,您可以直接运行代码。一键运行

示例代码

variable "region" {
  default = "cn-shenzhen"
}

variable "zone_id" {
  default = "cn-shenzhen-c"
}

variable "instance_type" {
  default = "pg.n2.2c.2m"
}

variable "target_minor_version" {
  default = "rds_postgres_1300_20240830"
}

provider "alicloud" {
  region = var.region
}

# 创建VPC
resource "alicloud_vpc" "main" {
  vpc_name   = "alicloud"
  cidr_block = "172.16.0.0/16"
}

# 创建交换机
resource "alicloud_vswitch" "main" {
  vpc_id     = alicloud_vpc.main.id
  cidr_block = "172.16.192.0/20"
  zone_id    = var.zone_id
}

# 创建RDS PostgreSQL实例
resource "alicloud_db_instance" "instance" {
  engine                 = "PostgreSQL"
  engine_version         = "13.0"
  instance_type          = var.instance_type
  instance_storage       = "30"
  instance_charge_type   = "Postpaid"
  vswitch_id             = alicloud_vswitch.main.id
  # 开启SQL审计(创建完RDS PostgreSQL实例后添加如下代码)
  sql_collector_status   = "Enabled"
  # 关闭SQL审计
  # sql_collector_status = "Disabled"
}                    

如果您想体验更多完整示例,请前往更多完整示例中对应产品的文件夹查看。

相关文档

  • Terraform介绍,请参见Terraform产品介绍

  • 当您遇到由于网络延迟等原因造成的terraform init超时,导致无法正常下载Provider等情况时,请参见Terraform Init 加速方案配置

  • 通过RDS控制台,您也可以开启和关闭SQL审计,详情请参见SQL审计(数据库审计)

  • 您也可以使用DAS的SQL洞察和审计功能,更好地获取RDS数据库实例SQL语句的具体信息,排查各种性能问题。详情请参见SQL洞察和审计

  • 资源编排服务为Terraform提供了托管的能力,您可以创建Terraform类型的模板,定义RDS资源,配置资源参数和资源间的依赖关系。更多信息,请参见创建Terraform类型模板