Skip to content

Latest commit

 

History

History
540 lines (517 loc) · 83.4 KB

File metadata and controls

540 lines (517 loc) · 83.4 KB

Package apache-airflow-providers-google

Google services including:

This is detailed commit list of changes for versions provider package: google. For high-level changelog, see :doc:`package information including changelog <index>`.

2.2.0

Latest change: 2021-04-06

Commit Committed Subject
042be2e4e 2021-04-06 Updated documentation for provider packages before April release (#15236)
eae22cec9 2021-04-06 Adds 'Trino' provider (with lower memory footprint for tests) (#15187)
e49722859 2021-04-05 Updates 3.6 limits for latest versions of a few libraries (#15209)
1d641d8f1 2021-04-01 update remaining old import paths of operators (#15127)
099c490cf 2021-03-28 Override project in dataprocSubmitJobOperator (#14981)
537969889 2021-03-27 Improve docstrings for various modules (#15047)
a7ca1b3b0 2021-03-26 Fix Sphinx Issues with Docstrings (#14968)
a7e144bec 2021-03-23 Google Dataflow Hook to handle no Job Type (#14914)
72ea841b4 2021-03-22 GCS to BigQuery Transfer Operator with Labels and Description parameter (#14881)
e172bd0e1 2021-03-22 Update docstrings to adhere to sphinx standards (#14918)
68e4c4dcb 2021-03-20 Remove Backport Providers (#14886)
ddc9133d3 2021-03-15 Add GCS timespan transform operator (#13996)
943baff67 2021-03-10 Add job labels to bigquery check operators. (#14685)
6dc24c95e 2021-03-07 Fix grammar and remove duplicate words (#14647)
e7bb17aeb 2021-03-06 Use built-in 'cached_property' on Python 3.8 where possible (#14606)
7daebefd1 2021-03-05 Use libyaml C library when available. (#14577)
35c9a9029 2021-03-01 Add Google leveldb hook and operator (#13109) (#14105)

2.1.0

Latest change: 2021-02-27

Commit Committed Subject
589d6dec9 2021-02-27 Prepare to release the next wave of providers: (#14487)
50a1504c5 2021-02-27 Fix spellings (#14483)
bfef559cf 2021-02-27 Corrects order of argument in docstring in GCSHook.download method (#14497)
33214d932 2021-02-26 Refactor SQL/BigQuery/Qubole/Druid Check operators (#12677)
c28197998 2021-02-23 Documentation and example dag for CloudDLPDeidentifyContentOperator, GCSObjectExistenceSensor, GCSObjectsWithPrefixExistenceSensor (#14033)
ca35bd7f7 2021-02-21 By default PIP will install all packages in .local folder (#14125)
a7e4266d6 2021-02-21 Refactor GoogleDriveToGCSOperator to use common methods (#14276)
1ab406663 2021-02-16 Add GoogleDriveToLocalOperator (#14191)
59c94c679 2021-02-13 Add 'exists_ok' flag to BigQueryCreateEmptyTable(Dataset)Operator (#14026)
e31b27d59 2021-02-13 Add materialized view support for BigQuery (#14201)
e3bcaa3ba 2021-02-12 Correct typo in GCSObjectsWtihPrefixExistenceSensor (#14179)
7faa2d978 2021-02-10 Add BigQueryUpdateTableOperator (#14149)
1da697216 2021-02-10 Fixes to dataproc operators and hook (#14086)
02288cf2b 2021-02-10 Add param to CloudDataTransferServiceOperator (#14118)
7d3864547 2021-02-09 #9803 fix bug in copy operation without wildcard (#13919)
b0c382426 2021-02-07 Add gdrive_to_gcs operator, drive sensor, additional functionality to drive hook, and supporting tests (#13982)
5d7d46bb3 2021-02-05 Improve GCSToSFTPOperator paths handling (#11284)
10343ec29 2021-02-05 Corrections in docs and tools after releasing provider RCs (#14082)

2.0.0

Latest change: 2021-02-04

Commit Committed Subject
88bdcfa0d 2021-02-04 Prepare to release a new wave of providers. (#14013)
1872d8719 2021-02-03 Add Apache Beam operators (#12814)
0e8c77b93 2021-02-03 Support google-cloud-logging' >=2.0.0 (#13801)
833e33832 2021-02-02 Fix four bugs in StackdriverTaskHandler (#13784)
d2efb3323 2021-02-02 Support google-cloud-monitoring>=2.0.0 (#13769)
ac2f72c98 2021-02-01 Implement provider versioning tools (#13767)
823741cfe 2021-01-28 Improve GCS system test envs (#13946)
6d6588fe2 2021-01-28 Add Google Cloud Workflows Operators (#13366)
810c15ed8 2021-01-27 Fix and improve GCP BigTable hook and system test (#13896)
661661733 2021-01-27 Add env variables to PubSub example dag (#13794)
f473ca713 2021-01-24 Replace 'google_cloud_storage_conn_id' by 'gcp_conn_id' when using 'GCSHook' (#13851)
a9ac2b040 2021-01-23 Switch to f-strings using flynt. (#13732)
9592be88e 2021-01-22 Fix Google Spanner example dag (#13842)
af52fdb51 2021-01-22 Improve environment variables in GCP Dataflow system test (#13841)
e7946f1cb 2021-01-22 Improve environment variables in GCP Datafusion system test (#13837)
61c1d6ec6 2021-01-22 Improve environment variables in GCP Memorystore system test (#13833)
202f66093 2021-01-22 Improve environment variables in GCP Lifeciences system test (#13834)
70bf307f3 2021-01-21 Add How To Guide for Dataflow (#13461)
3fd5ef355 2021-01-21 Add missing logos for integrations (#13717)
309788e5e 2021-01-18 Refactor DataprocOperators to support google-cloud-dataproc 2.0 (#13256)
7ec858c45 2021-01-17 updated Google DV360 Hook to fix SDF issue (#13703)
ef8617ec9 2021-01-14 Support google-cloud-tasks>=2.0.0 (#13347)
189af5404 2021-01-13 Add system tests for Stackdriver operators (#13644)
a6f999b62 2021-01-11 Support google-cloud-automl >=2.1.0 (#13505)
947dbb73b 2021-01-11 Support google-cloud-datacatalog>=3.0.0 (#13534)
2fb68342b 2021-01-07 Replace deprecated module and operator in example_tasks.py (#13527)
003584bbf 2021-01-05 Fix failing backport packages test (#13497)
7d1ea4cb1 2021-01-05 Replace deprecated module and operator in example_tasks.py (#13473)
c7d75ad88 2021-01-05 Revert "Support google-cloud-datacatalog 3.0.0 (#13224)" (#13482)
feb84057d 2021-01-04 Support google-cloud-datacatalog 3.0.0 (#13224)
3a3e73998 2021-01-04 Fix insert_all method of BigQueryHook to support tables without schema (#13138)
c33d2c06b 2021-01-02 Fix another pylint c-extension-no-member (#13438)
f6518dd6a 2021-01-02 Generalize MLEngineStartTrainingJobOperator to custom images (#13318)
9de712708 2020-12-31 Support google-cloud-bigquery-datatransfer>=3.0.0 (#13337)
406181d64 2020-12-31 Add Parquet data type to BaseSQLToGCSOperator (#13359)
295d66f91 2020-12-30 Fix Grammar in PIP warning (#13380)
13a9747bf 2020-12-28 Revert "Support google-cloud-tasks>=2.0.0 (#13334)" (#13341)
04ec45f04 2020-12-28 Add DataprocCreateWorkflowTemplateOperator (#13338)
1f712219f 2020-12-28 Support google-cloud-tasks>=2.0.0 (#13334)
f4745c8ce 2020-12-26 Fix typo in example (#13321)
e9d65bd45 2020-12-24 Decode Remote Google Logs (#13115)
e7aeacf33 2020-12-24 Add OracleToGCS Transfer (#13246)
323084e97 2020-12-24 Add timeout option to gcs hook methods. (#13156)
0b626c804 2020-12-22 Support google-cloud-redis>=2.0.0 (#13117)
9042a5855 2020-12-22 Add more operators to example DAGs for Cloud Tasks (#13235)
8c00ec89b 2020-12-22 Support google-cloud-pubsub>=2.0.0 (#13127)
b26b0df5b 2020-12-22 Update compatibility with google-cloud-kms>=2.0 (#13124)
9a1d3820d 2020-12-22 Support google-cloud-datacatalog>=1.0.0 (#13097)
f95b1c9c9 2020-12-21 Add regional support to dataproc workflow template operators (#12907)
6cf76d7ac 2020-12-18 Fix typo in pip upgrade command :( (#13148)
23f27c1b1 2020-12-18 Add system tests for CloudKMSHook (#13122)
cddbf81b1 2020-12-17 Fix Google BigQueryHook method get_schema() (#13136)
1259c712a 2020-12-17 Update compatibility with google-cloud-os-login>=2.0.0 (#13126)
bcf77586e 2020-12-16 Fix Data Catalog operators (#13096)
5090fb0c8 2020-12-15 Add script to generate integrations.json (#13073)
b4b9cf559 2020-12-14 Check for missing references to operator guides (#13059)
1c1ef7ee6 2020-12-14 Add project_id to client inside BigQuery hook update_table method (#13018)

1.0.0

Latest change: 2020-12-09

Commit Committed Subject
32971a1a2 2020-12-09 Updates providers versions to 1.0.0 (#12955)
b40dffa08 2020-12-08 Rename remaing modules to match AIP-21 (#12917)
9b39f2478 2020-12-08 Add support for dynamic connection form fields per provider (#12558)
1dcd3e13f 2020-12-05 Add support for extra links coming from the providers (#12472)
2037303ee 2020-11-29 Adds support for Connection/Hook discovery from providers (#12466)
02d94349b 2020-11-29 Don't use time.time() or timezone.utcnow() for duration calculations (#12353)
76bcd08dc 2020-11-28 Added '@apply_defaults' decorator. (#12620)
e1ebfa68b 2020-11-27 Add DataflowJobMessagesSensor and DataflowAutoscalingEventsSensor (#12249)
3fa51f94d 2020-11-24 Add check for duplicates in provider.yaml files (#12578)
c34ef853c 2020-11-20 Separate out documentation building per provider (#12444)
9e3b2c554 2020-11-19 GCP Secrets Optional Lookup (#12360)
008035450 2020-11-18 Update provider READMEs for 1.0.0b2 batch release (#12449)
7ca0b6f12 2020-11-18 Enable Markdownlint rule MD003/heading-style/header-style (#12427) (#12438)
8d0950646 2020-11-18 Fix download method in GCSToBigQueryOperator (#12442)
2c0920fba 2020-11-17 Adds mechanism for provider package discovery. (#12383)
2cda2f2a0 2020-11-17 Add missing pre-commit definition - provider-yamls (#12393)
80a957f14 2020-11-17 Add Dataflow sensors - job metrics (#12039)
ae7cb4a1e 2020-11-17 Update wrong commit hash in backport provider changes (#12390)
917e6c442 2020-11-16 Add provide_file_and_upload to GCSHook (#12310)
cfa4ecfeb 2020-11-15 Add DataflowJobStatusSensor and support non-blocking execution of jobs (#11726)
6889a333c 2020-11-15 Improvements for operators and hooks ref docs (#12366)
7825e8f59 2020-11-13 Docs installation improvements (#12304)
32b59f835 2020-11-12 Fixes the sending of an empty list to BigQuery 'list_rows' (#12307)
250436d96 2020-11-10 Fix spelling in Python files (#12230)
502ba309e 2020-11-10 Enable Markdownlint rule - MD022/blanks-around-headings (#12225)
dd2095f4a 2020-11-10 Simplify string expressions & Use f-string (#12216)
f37c6e6fc 2020-11-10 Add Compute Engine SSH hook (#9879)
85a18e13d 2020-11-09 Point at pypi project pages for cross-dependency of provider packages (#12212)
59eb5de78 2020-11-09 Update provider READMEs for up-coming 1.0.0beta1 releases (#12206)
61feb6ec4 2020-11-09 Provider's readmes generated for elasticsearch and google packages (#12194)
b2a28d159 2020-11-09 Moves provider packages scripts to dev (#12082)
fcb6b00ef 2020-11-08 Add authentication to AWS with Google credentials (#12079)
2ef3b7ef8 2020-11-08 Fix ERROR - Object of type 'bytes' is not JSON serializable when using store_to_xcom_key parameter (#12172)
0caec9fd3 2020-11-06 Dataflow - add waiting for successful job cancel (#11501)
cf9437d79 2020-11-06 Simplify string expressions (#12123)
91a64db50 2020-11-04 Format all files (without excepions) by black (#12091)
fd3db778e 2020-11-04 Add server side cursor support for postgres to GCS operator (#11793)
f1f194026 2020-11-04 Add DataflowStartSQLQuery operator (#8553)
41bf172c1 2020-11-04 Simplify string expressions (#12093)
5f5244b74 2020-11-04 Add template fields renderers to Biguery and Dataproc operators (#12067)
4e8f9cc8d 2020-11-03 Enable Black - Python Auto Formmatter (#9550)
8c42cf1b0 2020-11-03 Use PyUpgrade to use Python 3.6 features (#11447)
45ae145c2 2020-11-03 Log BigQuery job id in insert method of BigQueryHook (#12056)
e324b37a6 2020-11-03 Add job name and progress logs to Cloud Storage Transfer Hook (#12014)
6071fdd58 2020-11-02 Improve handling server errors in DataprocSubmitJobOperator (#11947)
2f703df12 2020-10-30 Add SalesforceToGcsOperator (#10760)
e5713e00b 2020-10-29 Add drain option when canceling Dataflow pipelines (#11374)
37eaac3c5 2020-10-29 The PRs which are not approved run subset of tests (#11828)
79cb77199 2020-10-28 Fixing re pattern and changing to use a single character class. (#11857)
5a439e84e 2020-10-26 Prepare providers release 0.0.2a1 (#11855)
240c7d4d7 2020-10-26 Google Memcached hooks - improve protobuf messages handling (#11743)
8afdb6ac6 2020-10-26 Fix spellings (#11825)
872b1566a 2020-10-25 Generated backport providers readmes/setup for 2020.10.29 (#11826)
6ce855af1 2020-10-24 Fix spelling (#11821)
483068745 2020-10-24 Use Python 3 style super classes (#11806)
727c739af 2020-10-22 Improve Cloud Memorystore for Redis example (#11735)
1da8379c9 2020-10-22 Fix static checks after merging #10121 (#11737)
91503308c 2020-10-22 Add Google Cloud Memorystore Memcached Operators (#10121)
950c16d0b 2020-10-21 Retry requests in case of error in Google ML Engine Hook (#11712)
2bfc53b5e 2020-10-21 Fix doc errors in google provider files. (#11713)
53e606210 2020-10-21 Enforce strict rules for yamllint (#11709)
349b0811c 2020-10-20 Add D200 pydocstyle check (#11688)
2d854c350 2020-10-19 Add service_account to Google ML Engine operator (#11619)
46a121fb7 2020-10-18 docs: Update Bigquery clustering docstrings (#11232)
49c58147f 2020-10-18 Strict type checking for provider Google (#11609)
0823d46a7 2020-10-16 Add type annotations for AWS operators and hooks (#11434)
3c10ca650 2020-10-16 Add DataflowStartFlexTemplateOperator (#8550)
8865d14df 2020-10-16 Strict type checking for provider google cloud (#11548)
16e712971 2020-10-13 Added support for provider packages for Airflow 2.0 (#11487)
06141d6d0 2020-10-12 Google cloud operator strict type check (#11450)
d305876be 2020-10-12 Remove redundant None provided as default to dict.get() (#11448)
1845cd11b 2020-10-11 Strict type check for google ads and cloud hooks (#11390)
bd204bb91 2020-10-11 Optionally set null marker in csv exports in BaseSQLToGCSOperator (#11409)
75071831b 2020-10-10 Remove redundant parentheses from Python files (#10967)
8baf657fc 2020-10-09 Fix regression in DataflowTemplatedJobStartOperator (#11167)
b0fcf6755 2020-10-07 Add AzureFileShareToGCSOperator (#10991)
47b05a87f 2020-10-07 Improve handling of job_id in BigQuery operators (#11287)
0a0e1af80 2020-10-03 Fix Broken Markdown links in Providers README TOC (#11249)
ca4238eb4 2020-10-02 Fixed month in backport packages to October (#11242)
5220e4c38 2020-10-02 Prepare Backport release 2020.09.07 (#11238)
cb52fb0ae 2020-09-27 Add example DAG and system test for MySQLToGCSOperator (#10990)
99accec29 2020-09-25 Fix incorrect Usage of Optional[str] & Optional[int] (#11141)
e3f96ce7a 2020-09-24 Fix incorrect Usage of Optional[bool] (#11138)
daf8f3108 2020-09-23 Add template fields renderers for better UI rendering (#11061)
f3e87c503 2020-09-22 Add D202 pydocstyle check (#11032)
cb979f9f2 2020-09-22 Get Airflow configs with sensitive data from CloudSecretManagerBackend (#11024)
76545bb3d 2020-09-16 Add example dag and system test for S3ToGCSOperator (#10951)
22c631625 2020-09-16 Fix more docs spellings (#10965)
12a652f53 2020-09-13 Fix parameter name collision in AutoMLBatchPredictOperator #10723 (#10869)
41a62735e 2020-09-11 Add on_kill method to BigQueryInsertJobOperator (#10866)
3e91da56e 2020-09-11 fix typo in firebase/example_filestore DAG (#10875)
68cc7273b 2020-09-10 Add on_kill method to DataprocSubmitJobOperator (#10847)
f92095721 2020-09-10 Fix and remove some more typos from spelling_wordlist.txt (#10845)
9549274d1 2020-09-09 Upgrade black to 20.8b1 (#10818)
078bfaf60 2020-09-08 Extract missing gcs_to_local example DAG from gcs example (#10767)
10ce31127 2020-09-08 Deprecate using global as the default region in Google Dataproc operators and hooks (#10772)
f14f37971 2020-09-07 [AIRFLOW-10672] Refactor BigQueryToGCSOperator to use new method (#10773)
c8ee45568 2020-09-07 Refactor DataprocCreateCluster operator to use simpler interface (#10403)
ece685b5b 2020-09-05 Asynchronous execution of Dataproc jobs with a Sensor (#10673)
6e3d7b63d 2020-09-04 Add masterConfig parameter to MLEngineStartTrainingJobOperator (#10578)
804548d58 2020-09-01 Add Dataprep operators (#10304)
11c00bc82 2020-08-30 Fix typos: duplicated "the" (#10647)
2ca615cff 2020-08-29 Update Google Cloud branding (#10642)
1b533f617 2020-08-28 Fix broken master - DLP (#10635)
5ae82a56d 2020-08-28 Fix Google DLP example and improve ops idempotency (#10608)
3867f7662 2020-08-28 Update Google Cloud branding (#10615)
91ff31ad1 2020-08-27 Documentation for Google Cloud Data Loss Prevention (#8201) (#9651)
fdd9b6f65 2020-08-25 Enable Black on Providers Packages (#10543)
d76026545 2020-08-25 PyDocStyle: No whitespaces allowed surrounding docstring text (#10533)
d1bce91bb 2020-08-25 PyDocStyle: Enable D403: Capitalized first word of docstring (#10530)
866701c80 2020-08-25 Fix typo in "Cloud" (#10534)
47265e7b5 2020-08-24 Fix typo in PostgresHook (#10529)
3696c34c2 2020-08-24 Fix typo in the word "release" (#10528)
2f2d8dbfa 2020-08-25 Remove all "noinspection" comments native to IntelliJ (#10525)
3734876d9 2020-08-24 Implement impersonation in google operators (#10052)
b0598b535 2020-08-24 Add support for creating multiple replicated clusters in Bigtable hook and operator (#10475)
ee7ca128a 2020-08-22 Fix broken Markdown refernces in Providers README (#10483)
515cc72c9 2020-08-22 Fix typo in timed_out (#10459)
7c206a82a 2020-08-22 Replace assigment with Augmented assignment (#10468)
88c7d2e52 2020-08-21 Dataflow operators don't not always create a virtualenv (#10373)
083c3c129 2020-08-18 Simplified GCSTaskHandler configuration (#10365)
1ae5bdf23 2020-08-17 Add test for GCSTaskHandler (#9600) (#9861)
e195a980b 2020-08-16 Add type annotations for mlengine_operator_utils (#10297)
382c1011b 2020-08-16 Add Bigtable Update Instance Hook/Operator (#10340)
bfa5a8d5f 2020-08-15 CI: Fix failing docs-build (#10342)
be46d20fb 2020-08-15 Improve idempotency of BigQueryInsertJobOperator (#9590)
47387a69e 2020-08-14 Catch Permission Denied exception when getting secret from GCP Secret Manager. (#10326)
2f0613b0c 2020-08-13 Implement Google BigQuery Table Partition Sensor (#10218)
f6734b3b8 2020-08-12 Enable Sphinx spellcheck for doc generation (#10280)
8f8db8959 2020-08-12 DbApiHook: Support kwargs in get_pandas_df (#9730)
ef088314f 2020-08-09 Added DataprepGetJobsForJobGroupOperator (#10246)
b43f90abf 2020-08-09 Fix various typos in the repo (#10263)
c29533888 2020-08-08 Add labels param to Google MLEngine Operators (#10222)
cdec30125 2020-08-07 Add correct signature to all operators and sensors (#10205)
eff0f0321 2020-08-06 `` Update guide for Google Cloud Secret Manager Backend (#10172)``
24c8e4c2d 2020-08-06 Changes to all the constructors to remove the args argument (#10163)
010322692 2020-08-06 Improve handling Dataproc cluster creation with ERROR state (#9593)
1437cb749 2020-08-04 Add correct signatures for operators in google provider package (#10144)
6efa1b9cb 2020-08-03 Add additional Cloud Datastore operators (#10032)
27020f8e5 2020-08-03 Add try clause to DataFusionHook.wait_for_pipeline_state (#10031)
4e3799fec 2020-08-02 [AIRFLOW-4541] Replace os.mkdirs usage with pathlib.Path(path).mkdir (#10117)
85c56b173 2020-08-02 Add missing params to GCP Pub/Sub creation_subscription (#10106)
b79466c12 2020-08-02 Fix sensor not providing arguments for GCSHook (#10074)
4ee35d027 2020-08-02 Fix hook not passing gcp_conn_id to base class (#10075)
aeea71274 2020-08-02 Remove 'args' parameter from provider operator constructors (#10097)
4c84661ad 2020-07-31 Split Display Video 360 example into smaler DAGs (#10077)
59cbff087 2020-07-29 Fix docstrings in BigQueryGetDataOperator (#10042)
81b87d48e 2020-07-27 Add unit tests for GcpBodyFieldSanitizer in Google providers (#9996)
7d24b088c 2020-07-25 Stop using start_date in default_args in example_dags (2) (#9985)
8b10a4b35 2020-07-25 Stop using start_date in default_args in example_dags (#9982)
ef98edf4d 2020-07-23 Add more information about using GoogleAdsHook (#9951)
33f0cd265 2020-07-22 apply_default keeps the function signature for mypy (#9784)
39a0288a4 2020-07-22 Add Google Authentication for experimental API (#9848)
c2db0dfeb 2020-07-22 More strict rules in mypy (#9705) (#9906)
c4244e18b 2020-07-22 Fix calling 'get_client' in BigQueryHook.table_exists (#9916)
5eacc1642 2020-07-22 Add support for impersonation in GCP hooks (#9915)
1cfdebf5f 2020-07-21 Fix insert_job method of BigQueryHook (#9899)
c8c52e69c 2020-07-21 Remove type hint causing DeprecationWarning in Firestore operators (#9819)
eb6f1d1cf 2020-07-16 Fix typo in datafusion operator (#9859)
b01d95ec2 2020-07-15 Change DAG.clear to take dag_run_state (#9824)
6d65c15d1 2020-07-15 Add guide for AI Platform (previously Machine Learning Engine) Operators (#9798)
770de53eb 2020-07-15 BigQueryTableExistenceSensor needs to specify keyword arguments (#9832)
2d8dbacdf 2020-07-15 Add CloudVisionDeleteReferenceImageOperator (#9698)
9f017951b 2020-07-15 Add Google Deployment Manager Hook (#9159)
ed5004cca 2020-07-14 Allow 'replace' flag in gcs_to_gcs operator. (#9667)
553bb7af7 2020-07-13 Keep functions signatures in decorators (#9786)
68925904e 2020-07-13 Add multiple file upload functionality to GCS hook (#8849)
1de78e8f9 2020-07-12 Add Google Stackdriver link (#9765)
092d33f29 2020-07-11 Fix StackdriverTaskHandler + add system tests (#9761)
b2305660f 2020-07-09 Update example DAG for AI Platform operators (#9727)
23f80f34a 2020-07-08 Move gcs & wasb task handlers to their respective provider packages (#9714)
44d4ae809 2020-07-06 Upgrade to latest pre-commit checks (#9686)
a79e2d4c4 2020-07-06 Move provider's log task handlers to the provider package (#9604)
cd3d9d934 2020-07-02 Fix using .json template extension in GMP operators (#9566)
4799af30e 2020-06-30 Extend BigQuery example with include clause (#9572)
e33f1a12d 2020-06-30 Add template_ext to BigQueryInsertJobOperator (#9568)
40add26d4 2020-06-29 Remove almost all references to airflow.contrib (#9559)
c420dbd6e 2020-06-27 Bump Pylint to 2.5.3 (#9294)
0051c89cb 2020-06-26 nitpick fix (#9527)
87fdbd070 2020-06-25 Use literal syntax instead of function calls to create data structure (#9516)
7256f4caa 2020-06-22 Pylint fixes and deprecation of rare used methods in Connection (#9419)
e13a14c87 2020-06-21 Enable & Fix Whitespace related PyDocStyle Checks (#9458)
5b680e27e 2020-06-19 Don't use connection to store task handler credentials (#9381)
d0e7db402 2020-06-19 Fixed release number for fresh release (#9408)
416334e2e 2020-06-19 Properly propagated warnings in operators (#9348)
12af6a080 2020-06-19 Final cleanup for 2020.6.23rc1 release preparation (#9404)
c7e5bce57 2020-06-19 Prepare backport release candidate for 2020.6.23rc1 (#9370)
4e09c6442 2020-06-18 Adds GCP Secret Manager Hook (#9368)
40bf8f28f 2020-06-18 Detect automatically the lack of reference to the guide in the operator descriptions (#9290)
f6bd817a3 2020-06-16 Introduce 'transfers' packages (#9320)
639972d99 2020-06-16 Add support for latest Apache Beam SDK in Dataflow operators (#9323)
1459970b3 2020-06-15 Rename CloudBuildCreateBuildOperator to CloudBuildCreateOperator (#9314)
431ea3291 2020-06-15 Resolve upstream tasks when template field is XComArg (#8805)
aee6ab94e 2020-06-15 Wait for pipeline state in Data Fusion operators (#8954)
fb1c8b83d 2020-06-10 Add test for BQ operations using location (#9206)
a26afbfa5 2020-06-10 Make generated job_id more informative in BQ insert_job (#9203)
c41192fa1 2020-06-10 Upgrade pendulum to latest major version ~2.0 (#9184)
b1c8c5ed5 2020-06-09 Allows using private endpoints in GKEStartPodOperator (#9169)
5918efc86 2020-06-05 Add 3.8 to the test matrices (#8836)
9bcdadaf7 2020-06-05 Add 'main' param to template_fields in DataprocSubmitPySparkJobOperator (#9154)
f56811dff 2020-06-05 [AIRFLOW-6290] Create guide for GKE operators (#8883)
76962867b 2020-06-04 Fix sql_to_gcs hook gzip of schema_file (#9140)
17adcea83 2020-06-02 Fix handling of subprocess error handling in s3_file_transform and gcs (#9106)
789852546 2020-06-01 Add BigQueryInsertJobOperator (#8868)
29eb68b90 2020-05-31 Create guide for Dataproc Operators (#9037)
886afaf62 2020-05-29 Add example dag and system test for LocalFilesystemToGCSOperator (#9043)
a779c4dfc 2020-05-29 add separate example dags and system tests for GCSToGoogleSheetsOperator (#9066)
ada26be23 2020-05-29 Add correct description for dst param in LocalFilesystemToGCSOperator (#9055)
81b2761b8 2020-05-29 add example dag and system test for GoogleSheetsToGCSOperator (#9056)
0b0e4f7a4 2020-05-26 Preparing for RC3 relase of backports (#9026)
00642a46d 2020-05-26 Fixed name of 20 remaining wrongly named operators. (#8994)
3994030ea 2020-05-26 Refactor BigQuery operators (#8858)
cdb3f2545 2020-05-26 All classes in backport providers are now importable in Airflow 1.10 (#8991)
1d36b0303 2020-05-23 Fix references in docs (#8984)
cf5cf45e1 2020-05-23 Support YAML input for CloudBuildCreateOperator (#8808)
499493c5c 2020-05-19 [AIRFLOW-6586] Improvements to gcs sensor (#7197)
375d1ca22 2020-05-19 Release candidate 2 for backport packages 2020.05.20 (#8898)
841d81664 2020-05-19 Allow setting the pooling time in DLPHook (#8824)
12c5e5d8a 2020-05-17 Prepare release candidate for backport packages (#8891)
f3521fb0e 2020-05-16 Regenerate readme files for backport package release (#8886)
15273f0ea 2020-05-16 Check for same task instead of Equality to detect Duplicate Tasks (#8828)
92585ca4c 2020-05-15 Added automated release notes generation for backport operators (#8807)
e1e833bb2 2020-05-13 Update GoogleBaseHook to not follow 308 and use 60s timeout (#8816)
8b5491971 2020-05-12 Refactor BigQuery hook methods to use python library (#8631)
6911dfe83 2020-05-12 Fix template fields in Google operators (#8840)
4b06fde0f 2020-05-12 Fix Flake8 errors (#8841)
1d12c347c 2020-05-12 Refactor BigQuery check operators (#8813)
493b685d7 2020-05-10 Add separate example DAGs and system tests for google cloud speech (#8778)
79ef8bed8 2020-05-10 Added Upload Multiple Entity Read Files to specified big query dataset (#8610)
280f1f0c4 2020-05-10 Correctly restore upstream_task_ids when deserializing Operators (#8775)
58aefb23b 2020-05-08 Added SDFtoGCSOperator (#8740)
723c52c94 2020-05-07 Add documentation for SpannerDeployInstanceOperator (#8750)
25ee4211b 2020-05-06 Support all RuntimeEnvironment parameters in DataflowTemplatedJobStartOperator (#8531)
8d6f1aa4b 2020-05-05 Support num_retries field in env var for GCP connection (#8700)
67caae0f2 2020-05-04 Add system test for gcs_to_bigquery (#8556)
bc45fa675 2020-05-03 Add system test and docs for Facebook Ads operators (#8503)
a28c66f23 2020-04-30 [AIRFLOW-4734] Upsert functionality for PostgresHook.insert_rows() (#8625)
992a24ce4 2020-04-28 Split and improve BigQuery example DAG (#8529)
c1fb28230 2020-04-28 Refactor BigQueryHook dataset operations (#8477)
e8d0f8fea 2020-04-26 Improve idempodency in CloudDataTransferServiceCreateJobOperator (#8430)
37fdfa977 2020-04-26 [AIRFLOW-6281] Create guide for GCS to GCS transfer operators (#8442)
14b22e6ff 2020-04-25 Add hook and operator for Google Cloud Life Sciences (#8481)
72ddc94d1 2020-04-23 Pass location using parmamter in Dataflow integration (#8382)
912aa4b42 2020-04-23 Added GoogleDisplayVideo360DownloadLineItemsOperator (#8174)
57c8c0583 2020-04-22 Use python client in BQ hook create_empty_table/dataset and table_exists (#8377)
5d3a7eef3 2020-04-20 Allow multiple extra_packages in Dataflow (#8394)
79c99b1b6 2020-04-18 Added location parameter to BigQueryCheckOperator (#8273)
79d3f33c1 2020-04-17 Clean up temporary files in Dataflow operators (#8313)
efcffa323 2020-04-16 Add Dataproc SparkR Example (#8240)
b198a1fa9 2020-04-15 Create guide for BigQuery operators (#8276)
2636cc932 2020-04-14 Raise exception when GCP credential doesn't support account impersonation (#8213)
eee4ebaee 2020-04-14 Added Facebook Ads Operator #7887 (#8008)
8cae07ea1 2020-04-14 fixed typo (#8294)
45c898330 2020-04-13 Less aggressive eager upgrade of requirements (#8267)
1fd9ed384 2020-04-13 Add mypy plugin for decorators. (#8145)
327b0a9f7 2020-04-13 Added GoogleDisplayVideo360UploadLineItemsOperator (#8216)
bb5e403a3 2020-04-10 Honor schema type for MySQL to GCS data pre-process (#8090)
87969a350 2020-04-09 [AIRFLOW-6515] Change Log Levels from Info/Warn to Error (#8170)
3fc89f29f 2020-04-06 [AIRFLOW-7106] Cloud data fusion integration - Allow to pass args to start pipeline (#7849)
7ef75d239 2020-04-03 [AIRFLOW-7117] Honor self.schema in sql_to_gcs as schema to upload (#8049)
ed2bc0057 2020-04-02 Add Google Ads list accounts operator (#8007)
3808a6206 2020-04-01 Unify Google class/package names (#8033)
8a0240257 2020-03-31 Rename CloudBaseHook to GoogleBaseHook and move it to google.common (#8011)
8e8978007 2020-03-31 Add more refactor steps for providers.google (#8010)
aae3b8fb2 2020-03-31 Individual package READMEs (#8012)
779023968 2020-03-30 [AIRFLOW-7075] Operators for storing information from GCS into GA (#7743)
49abce521 2020-03-30 Improve system tests for Cloud Build (#8003)
0f19a930d 2020-03-29 Remove GKEStartPodOperator when backporting (#7908)
0e1c238b2 2020-03-28 Get Airflow Variables from GCP Secrets Manager (#7946)
eb4af4f94 2020-03-28 Make BaseSecretsBackend.build_path generic (#7948)
01f99426f 2020-03-28 Add download/upload operators for GCS and Google Sheets (#7866)
892522f8e 2020-03-26 Change signature of GSheetsHook methods (#7853)
bfd425157 2020-03-26 Improve idempotency in MLEngineHook.create_model (#7811)
f9c226343 2020-03-26 Fix CloudSecretsManagerBackend invalid connections_prefix (#7861)
e3920f12f 2020-03-26 Improve setUp/tearDown in Cloud Firestore system test (#7862)
8ba8a7295 2020-03-26 Improve example DAGs for Cloud Memorystore (#7855)
f7d1a437c 2020-03-26 Fix CloudMemorystoreCreateInstanceAndImportOperator operator (#7856)
beef6c230 2020-03-26 Improve authorization in GCP system tests (#7863)
5f165f3e4 2020-03-26 [AIRFLOW-5801] Get GCP credentials from file instead of JSON blob (#7869)
686d7d50b 2020-03-25 Standardize SecretBackend class names (#7846)
1982c3fdc 2020-03-24 Run Dataflow for ML Engine summary in venv (#7809)
eef87b995 2020-03-23 [AIRFLOW-7105] Unify Secrets Backend method interfaces (#7830)
529db07b2 2020-03-23 Improve Google PubSub hook publish method (#7831)
4bde99f13 2020-03-23 Make airflow/providers pylint compatible (#7802)
a001489b5 2020-03-23 Improve example DAG for ML Engine (#7810)
9e5a8e7f8 2020-03-23 Add call to Super class in 'google' providers (#7823)
b86bf79bf 2020-03-23 Fix typo in GCP credentials_provider's docstring (#7818)
56c013ce9 2020-03-23 Add missing docstring in BigQueryHook.create_empty_table (#7817)
426a79847 2020-03-23 Imrove support for laatest API in MLEngineStartTrainingJobOperator (#7812)
cdf1809fc 2020-03-23 [AIRFLOW-7104] Add Secret backend for GCP Secrets Manager (#7795)
27dac00e1 2020-03-22 [AIRFLOW-7099] Improve system test for cloud transfer service (#7794)
0daf5d729 2020-03-22 Add ability to specify a maximum modified time for objects in GCSToGCSOperator (#7791)
c8088c2bd 2020-03-20 [AIRFLOW-7100] Add GoogleAnalyticsGetAdsLinkOperator (#7781)
5106a2931 2020-03-20 [AIRFLOW-6752] Add GoogleAnalyticsRetrieveAdsLinksListOperator (#7748)
759ce2a80 2020-03-20 [AIRFLOW-6978] Add PubSubPullOperator (#7766)
6b9b214e4 2020-03-20 [AIRFLOW-6732] Add GoogleAdsHook and GoogleAdsToGcsOperator (#7692)
b11891696 2020-03-19 [AIRFLOW-7069] Fix cloudsql system tests (#7770)
ae854cae5 2020-03-19 [AIRFLOW-7082] Remove catch_http_exception decorator in GCP hooks (#7756)
7e1e954d2 2020-03-19 [AIRFLOW-7085] Cache credentials, project_id in GCP Base Hook (#7759)
6e21c139b 2020-03-19 [AIRFLOW-XXXX] Fix reference to GCP classes in guides (#7762)
ce022a3f7 2020-03-19 [AIRFLOW-XXXX] Add cross-references for operators guide (#7760)
029c84e55 2020-03-18 [AIRFLOW-5421] Add Presto to GCS transfer operator (#7718)
63a3102ed 2020-03-18 [AIRFLOW-7064] Add CloudFirestoreExportDatabaseOperator (#7725)
73305c7bd 2020-03-18 [AIRFLOW-7081] Remove env variables from GCP guide (#7755)
60fdbf6d9 2020-03-18 [AIRFLOW-5610] Add ability to specify multiple objects to copy in GCSToGCSOperator (#7728)
de7e934ca 2020-03-17 [AIRFLOW-7079] Remove redundant code for storing template_fields (#7750)
0de0347b2 2020-03-17 [AIRFLOW-6855]: Escape project_dataset_table in SQL query in gcs to bq … (#7475)
91557c6f8 2020-03-17 [AIRFLOW-7073] GKEStartPodOperator always use connection credentials (#7738)
51161dbd9 2020-03-16 [AIRFLOW-5664] Store timestamps with microseconds precision (#6354)
2bc020c43 2020-03-14 [AIRFLOW-7055] Verbose logging option for google provider (#7711)
c997cab42 2020-03-13 [AIRFLOW-6724] Add Google Analytics 360 Accounts Retrieve Operator (#7630)
137896f32 2020-03-12 [AIRFLOW-7034] Remove feature: Assigning Dag to task using Bitshift Op (#7685)
1f77f943d 2020-03-10 [AIRFLOW-6980] Improve system tests and building providers package (#7615)
bf9b6b6d7 2020-03-09 [AIRFLOW-5013] Add GCP Data Catalog Hook and operators (#7664)
e5130dc9f 2020-03-09 [AIRFLOW-2911] Add job cancellation capability to Dataflow service (#7659)
faf0df4b9 2020-03-09 [AIRFLOW-XXXX] Fix upsert operator in BQ example DAG (#7666)
42eef3821 2020-03-07 [AIRFLOW-6877] Add cross-provider dependencies as extras (#7506)
b5b9795f0 2020-03-07 [AIRFLOW-6973] Make GCSCreateBucketOperator idempotent (fix) (#7624)
6b65038fb 2020-03-06 [AIRFLOW-6990] Improve system tests for Google Marketing Platform (#7631)
755fe5224 2020-03-05 [AIRFLOW-6915] Add AI Platform Console Link for MLEngineStartTrainingJobOperator (#7535)
cb2f33911 2020-03-04 [AIRFLOW-6973] Make GCSCreateBucketOperator idempotent (#7609)
09fea3ce8 2020-03-04 [AIRFLOW-6977] Fix BigQuery DTS example DAG (#7612)
8230ccc48 2020-03-04 [AIRFLOW-6926] Fix Google Tasks operators return types and idempotency (#7547)
0d1e3088a 2020-03-04 [AIRFLOW-6970] Improve GCP Video Intelligence system tests (#7604)
ab6bb0012 2020-03-03 [AIRFLOW-6971] Fix return type in CloudSpeechToTextRecognizeSpeechOperator (#7607)
3db4ade3d 2020-02-29 [AIRFLOW-6924] Fix Google DLP operators return types (#7546)
008b4bab1 2020-02-27 [AIRFLOW-6730] Use total_seconds instead of seconds (#7363)
bb552b2d9 2020-02-25 [AIRFLOW-6908] Lazy load AirflowException (#7528)
d1a34246a 2020-02-25 [AIRFLOW-6593] Add GCP Stackdriver Alerting Hooks and Operators (#7322)
3320e432a 2020-02-24 [AIRFLOW-6817] Lazy-load 'airflow.DAG' to keep user-facing API untouched (#7517)
dcf874352 2020-02-24 [AIRFLOW-6894] Prevent db query in example_dags (#7516)
4d03e33c1 2020-02-22 [AIRFLOW-6817] remove imports from 'airflow/__init__.py', replaced implicit imports with explicit imports, added entry to 'UPDATING.MD' - squashed/rebased (#7456)
35b961637 2020-02-21 [AIRFLOW-4973] Add Cloud Data Fusion Pipeline integration (#7486)
aff3a361b 2020-02-20 [AIRFLOW-6558] Campaign Manager operators for conversions (#7420)
9cbd7de6d 2020-02-18 [AIRFLOW-6792] Remove _operator/_hook/_sensor in providers package and add tests (#7412)
5b199cb86 2020-02-17 [AIRFLOW-XXXX] Typo in example_bigquery DAG (#7429)
2c9345a8e 2020-02-17 [AIRFLOW-6759] Added MLEngine operator/hook to cancel MLEngine jobs (#7400)
946bdc23c 2020-02-16 [AIRFLOW-6405] Add GCP BigQuery Table Upsert Operator (#7126)
2381c820c 2020-02-13 [AIRFLOW-6505] Let emoji encoded properly for json.dumps() (#7399)
04c1fefbf 2020-02-03 [AIRFLOW-6676] added GCSDeleteBucketOperator (#7307)
a0252748f 2020-02-03 [AIRFLOW-6717] Remove non-existent field from templated_fields (#7340)
97a429f9d 2020-02-02 [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338)
9d8d07557 2020-02-03 [AIRFLOW-6715] Fix Google Cloud DLP Example DAG (#7337)
cf141506a 2020-02-02 [AIRFLOW-6708] Set unique logger names (#7330)
373c6aa4a 2020-01-30 [AIRFLOW-6682] Move GCP classes to providers package (#7295)
83c037873 2020-01-30 [AIRFLOW-6674] Move example_dags in accordance with AIP-21 (#7287)
057f3ae3a 2020-01-29 [AIRFLOW-6670][depends on AIRFLOW-6669] Move contrib operators to providers package (#7286)
ceea293c1 2020-01-28 [AIRFLOW-6656] Fix AIP-21 moving (#7272)
c42a375e7 2020-01-27 [AIRFLOW-6644][AIP-21] Move service classes to providers package (#7265)
059eda05f 2020-01-21 [AIRFLOW-6610] Move software classes to providers package (#7231)
f4d3e5e54 2020-01-13 [AIRFLOW-6102] [AIP-21] Rename Dataproc operators (#7151)
e7bf8ecb4 2020-01-13 [AIRFLOW-6119] [AIP-21] Rename GCS operators, hooks and sensors (#7125)
5b6772cb8 2020-01-09 [AIRFLOW-6125] [AIP-21] Rename S3 operator and SFTP operator (#7112)
4f8592ae8 2020-01-08 [AIRFLOW-6118] [AIP-21] Rename Pubsub operators and hook (#7046)
20299473f 2020-01-03 [AIRFLOW-6115] [AIP-21] Rename GCP vision operators (#7020)
18e8cea4e 2020-01-03 [AIRFLOW-6428] Fix import path for airflow.utils.dates.days_ago in Example DAGs (#7007)
95087af14 2019-12-31 [AIRFLOW-6110] [AIP-21] Rename natural_language service (#6968)
69629a5a9 2019-12-09 [AIRFLOW-5807] Move SFTP from contrib to providers. (#6464)
25e9047a4 2019-12-09 [AIRFLOW-6193] Do not use asserts in Airflow main code (#6749)
ed0a14f32 2019-12-09 [AIRFLOW-6120] Rename GoogleCloudBaseHook (#6734)
2f2f89c14 2019-12-01 [AIRFLOW-6139] Consistent spaces in pylint enable/disable (#6701)
03c870a61 2019-11-26 [AIRFLOW-6010] Remove cyclic imports and pylint hacks (#6601)
5c4cfea8c 2019-11-15 [AIRFLOW-5718] Add SFTPToGoogleCloudStorageOperator (#6393)
44a8c37a9 2019-11-13 [AIRFLOW-XXX] Fix the docstring for Dataproc get_job method (#6581)
d633d3ac4 2019-11-13 [AIRFLOW-5691] Rewrite Dataproc operators to use python library (#6371)
d985c02d9 2019-11-05 [AIRFLOW-XXX] Add How-To-Guide to GCP PubSub (#6497)
a296cdabd 2019-11-04 [AIRFLOW-5743] Move Google PubSub to providers package (#6476)
470b2a779 2019-10-30 [AIRFLOW-5741] Move Cloud Natural Language to providers (#6421)
f2caa451f 2019-10-27 [AIRFLOW-5742] Move Google Cloud Vision to providers package (#6424)
16d7accb2 2019-10-22 [AIRFLOW-4971] Add Google Display & Video 360 integration (#6170)
4e661f535 2019-10-22 [AIRFLOW-5379] Add Google Search Ads 360 operators (#6228)
19e32b4e2 2019-10-18 [AIRFLOW-5656] Rename provider to providers module (#6333)