如何通过指定分区将分区插入到Python中BigQuery的获取时间分区表中

相关文章推荐

儒雅的保温杯 · 联想小新Air14 ...· 9 月前 ·

温柔的长颈鹿 · 京基华樾(售楼处)首页网站-京基华樾-京基华 ...· 1 年前 ·

千年单身的警车 · 首发 | 大疆运动相机评测：性能比肩 ...· 1 年前 ·

奔放的生菜 · typescript - cdk ...· 2 年前 ·

踏实的移动电源 · Java – Spring ...· 2 年前 ·

腾讯云

开发者社区

文档意见反馈控制台

首页 TVP

文章/答案/技术大牛

发布

google.api_core.exceptions.BadRequest: 400 POST https://bigquery.googleapis.com/upload/bigquery/v2/projects/aaa/jobs?uploadType=multipart: Invalid field name "_PARTITIONTIME". Field names are not allowed to start with the (case-insensitive) prefixes _PARTITION, _TABLE_, _FILE_, _ROW_TIMESTAMP, __ROOT__ and _COLIDENTIFIER

CREATE TABLE IF NOT EXISTS `aaa.bbb.ccc`(
  c1 INTEGER,
  c2 STRING
PARTITION BY _PARTITIONDATE;

INSERT INTO `aaa.bbb.ccc` (c1, c2, _PARTITIONTIME) VALUES (99, "zz", TIMESTAMP("2000-01-02"));

import pandas as pd
from google.cloud import bigquery
from google.cloud.bigquery.enums import SqlTypeNames
from google.cloud.bigquery.job import WriteDisposition
from datetime import datetime
client = bigquery.Client(project="aaa")
job_config = bigquery.LoadJobConfig(
    schema=[
        bigquery.SchemaField("c1", SqlTypeNames.INTEGER),
        bigquery.SchemaField("c2", SqlTypeNames.STRING),
        bigquery.SchemaField("_PARTITIONTIME", SqlTypeNames.TIMESTAMP),
    write_disposition=WriteDisposition.WRITE_APPEND,
    time_partitioning=bigquery.TimePartitioning(
        type_=bigquery.TimePartitioningType.DAY,
        field="_PARTITIONTIME",  # Name of the column to use for partitioning.
        expiration_ms=7776000000,  # 90 days.
df = pd.DataFrame(
        [1, "a", datetime.strptime("2100-11-12", "%Y-%m-%d")],
        [2, "b", datetime.strptime("2101-12-13", "%Y-%m-%d")],
    columns=["c1", "c2", "_PARTITIONTIME"],
job = client.load_table_from_dataframe(df, "aaa.bbb.ccc", job_config=job_config) # error
result = job.result()

import pandas as pd
from google.cloud import bigquery
from google.cloud.bigquery.enums import SqlTypeNames
from google.cloud.bigquery.job import WriteDisposition
from datetime import datetime
client = bigquery.Client(project="<your-project>")
job_config = bigquery.LoadJobConfig(
    schema=[
        bigquery.SchemaField("c1", SqlTypeNames.INTEGER),
        bigquery.SchemaField("c2", SqlTypeNames.STRING),
        bigquery.SchemaField("_P1", SqlTypeNames.TIMESTAMP),
    write_disposition=WriteDisposition.WRITE_APPEND,
    time_partitioning=bigquery.TimePartitioning(
        type_=bigquery.TimePartitioningType.DAY,
        field="_P1",  # Name of the column to use for partitioning.
        expiration_ms=7776000000,  # 90 days.
df = pd.DataFrame(
        [1, "a", datetime.strptime("2100-11-12", "%Y-%m-%d")],

推荐文章

儒雅的保温杯 · 联想小新Air14 Touch锐龙触屏版14英寸轻薄笔记本电脑银_联想商城_价格_参数_多少钱_怎么样

9 月前

温柔的长颈鹿 · 京基华樾(售楼处)首页网站-京基华樾-京基华樾欢迎您-京基华樾楼盘详情 @售楼处_配套_深圳_户型图

1 年前

千年单身的警车 · 首发 | 大疆运动相机评测：性能比肩 GoPro， 2499 元售价是惊喜（防抖测试更新） | 爱范儿

1 年前

奔放的生菜 · typescript - cdk unable to Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is th

2 年前

踏实的移动电源 · Java – Spring NumberFormatException: Failed to convert value of type ‘java.lang.String’ to required type ‘java.lang.Long – iTecNot

2 年前

如何通过指定分区将分区插入到Python中BigQuery的获取时间分区表中

1 个回答