Funcotator Problem docker image code:400
Have been using this syntax for 4-5 yrs. Worked a week ago?
(gatk) root@927aafec98f5:/gatk# ./gatk Funcotator --version
Using GATK jar /gatk/gatk-package-4.4.0.0-local.jar
Running:
java -Dsamjdk.use_async_io_read_samtools=false -Dsamjdk.use_async_io_write_samtools=true -Dsamjdk.use_async_io_write_tribble=false -Dsamjdk.compression_level=2 -jar /gatk/gatk-package-4.4.0.0-local.jar Funcotator --version
The Genome Analysis Toolkit (GATK) v4.4.0.0
HTSJDK Version: 3.0.5
Picard Version: 3.0.0
(gatk) root@927aafec98f5:/gatk# ./gatk Funcotator -R mydata/refs/Homo_sapiens_assembly38.fasta -V mydata/SARC_00182a2_SavvyHyena/analysis/SARC_00182a2-1bef6_DT_SavvyHyena_mutect2_filtered_hg38.vcf -O mydata/SARC_00182a2_SavvyHyena/analysis/SARC_00182a2-1bef6_DT_SavvyHyena_mutect2_funcotator_hg38.maf --output-file-format MAF --data-sources-path mydata/dataSourcesFolder/funcotator_dataSources.v1.7.20200521s/ --verbosity DEBUG --ref-version hg38
Using GATK jar /gatk/gatk-package-4.4.0.0-local.jar
Running:
java -Dsamjdk.use_async_io_read_samtools=false -Dsamjdk.use_async_io_write_samtools=true -Dsamjdk.use_async_io_write_tribble=false -Dsamjdk.compression_level=2 -jar /gatk/gatk-package-4.4.0.0-local.jar Funcotator -R mydata/refs/Homo_sapiens_assembly38.fasta -V mydata/SARC_00182a2_SavvyHyena/analysis/SARC_00182a2-1bef6_DT_SavvyHyena_mutect2_filtered_hg38.vcf -O mydata/SARC_00182a2_SavvyHyena/analysis/SARC_00182a2-1bef6_DT_SavvyHyena_mutect2_funcotator_hg38.maf --output-file-format MAF --data-sources-path mydata/dataSourcesFolder/funcotator_dataSources.v1.7.20200521s/ --verbosity DEBUG --ref-version hg38
17:38:05.613 INFO NativeLibraryLoader - Loading libgkl_compression.so from jar:file:/gatk/gatk-package-4.4.0.0-local.jar!/com/intel/gkl/native/libgkl_compression.so
17:38:05.659 DEBUG NativeLibraryLoader - Extracting libgkl_compression.so to /tmp/libgkl_compression16904400460515253636.so
17:38:05.674 INFO Funcotator - ------------------------------------------------------------
17:38:05.679 INFO Funcotator - The Genome Analysis Toolkit (GATK) v4.4.0.0
17:38:05.679 INFO Funcotator - For support and documentation go to https://software.broadinstitute.org/gatk/
17:38:05.679 INFO Funcotator - Executing as root@927aafec98f5 on Linux v5.15.167.4-microsoft-standard-WSL2 amd64
17:38:05.679 INFO Funcotator - Java runtime: OpenJDK 64-Bit Server VM v17.0.6+10-Ubuntu-0ubuntu118.04.1
17:38:05.680 INFO Funcotator - Start Date/Time: February 21, 2025 at 5:38:05 PM GMT
17:38:05.680 INFO Funcotator - ------------------------------------------------------------
17:38:05.680 INFO Funcotator - ------------------------------------------------------------
17:38:05.682 INFO Funcotator - HTSJDK Version: 3.0.5
17:38:05.682 INFO Funcotator - Picard Version: 3.0.0
17:38:05.682 INFO Funcotator - Built for Spark Version: 3.3.1
17:38:05.686 INFO Funcotator - HTSJDK Defaults.BUFFER_SIZE : 131072
17:38:05.686 INFO Funcotator - HTSJDK Defaults.COMPRESSION_LEVEL : 2
17:38:05.687 INFO Funcotator - HTSJDK Defaults.CREATE_INDEX : false
17:38:05.688 INFO Funcotator - HTSJDK Defaults.CREATE_MD5 : false
17:38:05.688 INFO Funcotator - HTSJDK Defaults.CUSTOM_READER_FACTORY :
17:38:05.688 INFO Funcotator - HTSJDK Defaults.DISABLE_SNAPPY_COMPRESSOR : false
17:38:05.688 INFO Funcotator - HTSJDK Defaults.EBI_REFERENCE_SERVICE_URL_MASK : https://www.ebi.ac.uk/ena/cram/md5/%s
17:38:05.688 INFO Funcotator - HTSJDK Defaults.NON_ZERO_BUFFER_SIZE : 131072
17:38:05.689 INFO Funcotator - HTSJDK Defaults.REFERENCE_FASTA : null
17:38:05.689 INFO Funcotator - HTSJDK Defaults.SAM_FLAG_FIELD_FORMAT : DECIMAL
17:38:05.689 INFO Funcotator - HTSJDK Defaults.USE_ASYNC_IO_READ_FOR_SAMTOOLS : false
17:38:05.689 INFO Funcotator - HTSJDK Defaults.USE_ASYNC_IO_WRITE_FOR_SAMTOOLS : true
17:38:05.689 INFO Funcotator - HTSJDK Defaults.USE_ASYNC_IO_WRITE_FOR_TRIBBLE : false
17:38:05.689 INFO Funcotator - HTSJDK Defaults.USE_CRAM_REF_DOWNLOAD : false
17:38:05.689 DEBUG ConfigFactory - Configuration file values:
17:38:05.694 DEBUG ConfigFactory - gcsMaxRetries = 20
17:38:05.694 DEBUG ConfigFactory - gcsProjectForRequesterPays =
17:38:05.695 DEBUG ConfigFactory - gatk_stacktrace_on_user_exception = false
17:38:05.695 DEBUG ConfigFactory - samjdk.use_async_io_read_samtools = false
17:38:05.695 DEBUG ConfigFactory - samjdk.use_async_io_write_samtools = true
17:38:05.695 DEBUG ConfigFactory - samjdk.use_async_io_write_tribble = false
17:38:05.695 DEBUG ConfigFactory - samjdk.compression_level = 2
17:38:05.695 DEBUG ConfigFactory - spark.kryoserializer.buffer.max = 512m
17:38:05.695 DEBUG ConfigFactory - spark.driver.maxResultSize = 0
17:38:05.695 DEBUG ConfigFactory - spark.driver.userClassPathFirst = true
17:38:05.695 DEBUG ConfigFactory - spark.io.compression.codec = lzf
17:38:05.696 DEBUG ConfigFactory - spark.executor.memoryOverhead = 600
17:38:05.696 DEBUG ConfigFactory - spark.driver.extraJavaOptions =
17:38:05.696 DEBUG ConfigFactory - spark.executor.extraJavaOptions =
17:38:05.696 DEBUG ConfigFactory - codec_packages = [htsjdk.variant, htsjdk.tribble, org.broadinstitute.hellbender.utils.codecs]
17:38:05.696 DEBUG ConfigFactory - read_filter_packages = [org.broadinstitute.hellbender.engine.filters]
17:38:05.696 DEBUG ConfigFactory - annotation_packages = [org.broadinstitute.hellbender.tools.walkers.annotator]
17:38:05.696 DEBUG ConfigFactory - cloudPrefetchBuffer = 40
17:38:05.696 DEBUG ConfigFactory - cloudIndexPrefetchBuffer = -1
17:38:05.697 DEBUG ConfigFactory - createOutputBamIndex = true
17:38:05.697 INFO Funcotator - Deflater: IntelDeflater
17:38:05.697 INFO Funcotator - Inflater: IntelInflater
17:38:05.698 INFO Funcotator - GCS max retries/reopens: 20
17:38:05.698 INFO Funcotator - Requester pays: disabled
17:38:05.699 INFO Funcotator - Initializing engine
17:38:06.319 INFO FeatureManager - Using codec VCFCodec to read file file:///gatk/mydata/SARC_00182a2_SavvyHyena/analysis/SARC_00182a2-1bef6_DT_SavvyHyena_mutect2_filtered_hg38.vcf
17:38:06.567 INFO Funcotator - Done initializing engine
17:38:06.568 INFO Funcotator - Validating sequence dictionaries...
17:38:06.615 INFO Funcotator - Processing user transcripts/defaults/overrides...
17:38:06.616 INFO Funcotator - Initializing data sources...
17:38:06.621 INFO DataSourceUtils - Initializing data sources from directory: mydata/dataSourcesFolder/funcotator_dataSources.v1.7.20200521s/
17:38:06.649 INFO DataSourceUtils - Data sources version: 1.7.2020429s
17:38:06.649 INFO DataSourceUtils - Data sources source: ftp://gsapubftp-anonymous@ftp.broadinstitute.org/bundle/funcotator/funcotator_dataSources.v1.7.20200429s.tar.gz
17:38:06.649 INFO DataSourceUtils - Data sources alternate source: gs://broad-public-datasets/funcotator/funcotator_dataSources.v1.7.20200429s.tar.gz
17:38:06.721 INFO DataSourceUtils - Resolved data source file path: file:///gatk/gencode_xhgnc_v90_38.hg38.tsv -> file:///gatk/mydata/dataSourcesFolder/funcotator_dataSources.v1.7.20200521s/gencode_xhgnc/hg38/gencode_xhgnc_v90_38.hg38.tsv
17:38:06.741 INFO DataSourceUtils - Resolved data source file path: file:///gatk/oreganno.tsv -> file:///gatk/mydata/dataSourcesFolder/funcotator_dataSources.v1.7.20200521s/oreganno/hg38/oreganno.tsv
17:38:06.759 INFO DataSourceUtils - Resolved data source file path: file:///gatk/simple_uniprot_Dec012014.tsv -> file:///gatk/mydata/dataSourcesFolder/funcotator_dataSources.v1.7.20200521s/simple_uniprot/hg38/simple_uniprot_Dec012014.tsv
17:38:06.774 INFO DataSourceUtils - Resolved data source file path: file:///gatk/Cosmic.db -> file:///gatk/mydata/dataSourcesFolder/funcotator_dataSources.v1.7.20200521s/cosmic/hg38/Cosmic.db
17:38:07.604 INFO Funcotator - Shutting down engine
17:38:07.606 DEBUG FeatureDataSource - Cache statistics for FeatureInput drivingVariantFile:/gatk/mydata/SARC_00182a2_SavvyHyena/analysis/SARC_00182a2-1bef6_DT_SavvyHyena_mutect2_filtered_hg38.vcf:
17:38:07.607 DEBUG FeatureCache - Cache hit rate was 0.00% (0 out of 0 total queries)
17:38:07.607 DEBUG FeatureDataSource - Cache statistics for FeatureInput drivingVariantFile:/gatk/mydata/SARC_00182a2_SavvyHyena/analysis/SARC_00182a2-1bef6_DT_SavvyHyena_mutect2_filtered_hg38.vcf:
17:38:07.609 DEBUG FeatureCache - Cache hit rate was 0.00% (0 out of 0 total queries)
[February 21, 2025 at 5:38:07 PM GMT] org.broadinstitute.hellbender.tools.funcotator.Funcotator done. Elapsed time: 0.03 minutes.
Runtime.totalMemory()=285212672
code: 400
message: Bucket is a requester pays bucket but no user project provided.
reason: required
location: null
retryable: false
com.google.cloud.storage.StorageException: Bucket is a requester pays bucket but no user project provided.
at com.google.cloud.storage.spi.v1.HttpStorageRpc.translate(HttpStorageRpc.java:233)
at com.google.cloud.storage.spi.v1.HttpStorageRpc.get(HttpStorageRpc.java:458)
at com.google.cloud.storage.StorageImpl.lambda$get$6(StorageImpl.java:279)
at com.google.api.gax.retrying.DirectRetryingExecutor.submit(DirectRetryingExecutor.java:105)
at com.google.cloud.RetryHelper.run(RetryHelper.java:76)
at com.google.cloud.RetryHelper.runWithRetries(RetryHelper.java:50)
at com.google.cloud.storage.Retrying.run(Retrying.java:51)
at com.google.cloud.storage.StorageImpl.run(StorageImpl.java:1374)
at com.google.cloud.storage.StorageImpl.get(StorageImpl.java:278)
at com.google.cloud.storage.contrib.nio.CloudStorageFileSystemProvider.checkAccess(CloudStorageFileSystemProvider.java:732)
at java.base/java.nio.file.Files.exists(Files.java:2527)
at org.broadinstitute.hellbender.tools.funcotator.dataSources.DataSourceUtils.assertPathFilePropertiesField(DataSourceUtils.java:938)
at org.broadinstitute.hellbender.tools.funcotator.dataSources.DataSourceUtils.assertConfigFilePropertiesAreValid(DataSourceUtils.java:841)
at org.broadinstitute.hellbender.tools.funcotator.dataSources.DataSourceUtils.getAndValidateDataSourcesFromPaths(DataSourceUtils.java:216)
at org.broadinstitute.hellbender.tools.funcotator.Funcotator.onTraversalStart(Funcotator.java:781)
at org.broadinstitute.hellbender.engine.GATKTool.doWork(GATKTool.java:1096)
at org.broadinstitute.hellbender.cmdline.CommandLineProgram.runTool(CommandLineProgram.java:149)
at org.broadinstitute.hellbender.cmdline.CommandLineProgram.instanceMainPostParseArgs(CommandLineProgram.java:198)
at org.broadinstitute.hellbender.cmdline.CommandLineProgram.instanceMain(CommandLineProgram.java:217)
at org.broadinstitute.hellbender.Main.runCommandLineProgram(Main.java:160)
at org.broadinstitute.hellbender.Main.mainEntry(Main.java:203)
at org.broadinstitute.hellbender.Main.main(Main.java:289)
Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
GET https://storage.googleapis.com/storage/v1/b/broad-public-datasets/o/funcotator%2FgnomAD_2.1_VCF_INFO_AF_Only%2Fhg38%2Fgnomad.exomes.r2.1.sites.liftoverToHg38.INFO_ANNOTATIONS_FIXED.vcf.gz?fields=bucket,name,id&projection=full
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "Bucket is a requester pays bucket but no user project provided.",
"reason" : "required"
} ],
"message" : "Bucket is a requester pays bucket but no user project provided."
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:118)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:37)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:428)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1111)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:514)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:455)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:565)
at com.google.cloud.storage.spi.v1.HttpStorageRpc.get(HttpStorageRpc.java:455)
... 20 more
(gatk) root@927aafec98f5:/gatk#
-
Hi again. Funcotator bucket is fixed. You should be able to download data sources again.
Please sign in to leave a comment.
1 comment