google-cloud-storage's questions - English 1answer

4.523 google-cloud-storage questions.

How can I identify processed files in Data flow Job? I am using a wildcard to read files from cloud storage. but every time when the job runs, it re-read all files. This is a batch Job and following ...

I am an Android developer. I created a PHP API to communicate with my Android project. It works well in Godaddy. I want to move it to Google Cloud service. I deployed the PHP project, but it shows ...

I am trying to deploy sample weather dialog flow chat bot, I am deploying it as per instruction given in dialog flow manual for deploying index.js I am using following command gcloud beta functions ...

I would like to write an ETL Transform job, to query elements from BigQuery apply some transformation on them serialise into the TFRecords format dump the .tfrecords in a Cloud Storage bucket The ...

I am getting the below error message while trying to access my google cloud storage from one of my Google Compute Engine instance using gsutil command. Below is the command and error message. Command:...

I have the gsutil Tool installed on a CentOS 6.5 box which requires Python 2.6. According to CentOS 6.5 docs, we can't upgrade this to Python 2.7, but we can install and use Python 2.7 as a separate ...

I am trying to get gsutil working on my machine, and it always fails with the following error: ssl.SSLError: [Errno 185090050] _ssl.c:358: error:0B084002:x509 certificate routines:...

i want to get width and height of image stored in Google cloud storage without loading it in memory. i found answer on stackoverflow hre stating that if image type is not JPEG or TIFF then we can ...

Problem: I want to copy files from a folder in Google Cloud Storage Bucket (e.g Folder1 in Bucket1) to another Bucket (e.g Bucket2). I can't find any Airflow Operator for Google Cloud Storage to copy ...

I am trying to create a sink to monitor VPC_FLOW LOGS for all the projects in an organization and i am getting permission denied, has anybody else have a similar issue ?. Error is clear that it's ...

I'm trying to do a simple read of files in a GCS bucket into Dataproc Spark, and insert into a Hive table. I'm getting very poor network bandwidth (max 1MB/s) on downloading the files from the bucket. ...

I'm having trouble when uploading folders onto my google-cloud-storage bucket: They wont show up in the mounted drive /mnt/willferbucket (with gcsfuse) It doesnt matter if i upload them through the ...

I'm using google cloud storage with option rsync I create a cronjob that sync file every minute. But there're the problem Right on a file is being partially written, the cronjob run, then it sync a ...

I have a Javascript cloud function which resizes an image, stores each and writes the new signed url to the realtime database. It looks however that the new signed image url is publicly accessible. ...

I'm building a library for fetching encrypted secrets from cloud storage (in Scala, using the Java clients). I'm using the following google libraries: "com.google.apis" % "google-api-services-...

I am trying to create a bucket using Deployment manager but when I want to create the deployment, I get the following error: ERROR: (gcloud.deployment-manager.deployments.create) Error in Operation [...

I want to write an application which is portable. With "portable" I mean that it can be used to access these storages: amazon s3 google cloud storage Eucalyptus Storage The software should be ...

To upload objects to google cloud storage buckets, I need an authentication token. I have chosen JSON API method to upload objects to buckets. <?php $ch = curl_init(); curl_setopt($ch, CURLOPT_URL,...

Hello I have created a windows application which uploads image from hdd to google cloud server. My code was working perfectly but after changing bucket name it is not working. My both buckets are in ...

We have an automated FTP process set up which imports a data file into Google Cloud Storage daily. I would like to set up a daily automated job that uploads this csv into a bigquery table. What is ...

I am trying to create a new bucket with 2 empty folders within it on Google Cloud storage using python client library. I referred to the python client library API for GCS (https://google-cloud-python....

For django-storages and google compute engine (GCE), how do you create and set credentials for a web application? Here is the current documentation: http://django-storages.readthedocs.io/en/latest/...

With Firestore Documents you can trigger a function like this: functions.firestore.document('/accounts/{accountId}/rooms/{roomId}/messages/{messageId}').onWrite((event) => { const accountId = ...

How to create new empty files in Google Cloud Storage using Python with client libraries available? Or how to upload a new file to a selected bucket using blob function "upload_from_filename()" ? To ...

I want to download the object from GCP Bucket using JAVA. Here is the code sample which I have written: NetHttpTransport.Builder builder = new NetHttpTransport.Builder(); builder....

I am trying to upload images. I have got my signedUrl to my bucket, but I can't make a proper http put request. I am using the superagent library. const req = superagent.put(url) .attach(file.name, ...

I've written a Node function that reads a file from Google Cloud Storage and copies it to Google Drive. It is able to connect to GCS and create the file reference but fails when sending to Drive. The ...

I want to store IoT event data in Google Cloud Storage, which will be used as my data lake. But doing a PUT call for every event is too costly, therefore I want to append into a file, and then do a ...

I want to load data from hundreds of CSV files on Google cloud Storage and append them to a single table on Bigquery on a daily basis using cloud dataflow (preferable using python SDK). Can you please ...

Does anyone have an example of a GAE/Cloud Endpoints API method (in Java) that can take in an image from an Android app and upload it to Google Cloud Storage? I cannot seem to find any samples on how ...

I've spent a few hours trying to figure out the best practice here and I'm still coming up empty. It's possible I'm just phrasing the question wrong since this must be out there. Nevertheless... I ...

I try to upload a video in google bucket by using resumable upload. But I always have the same error : (u'Response headers must contain header', u'location') Here is my code: client = ...

It was pretty straight forward setting up a connection to Google Drive since there was options for it in the Logic App Designer. But I can't find any similar options for connecting to Google Cloud ...

After uploading a file in Firebase storage I want to call a firebase cloud function from my web app which will validate the file data I sent to it, and then store it in the real-time database. I am ...

Sorry for my noob question :( I'm trying to transfer data from a HTTPS server to my google bucket using google cloud transfer service. I've created the tsv file according to the documentation. But I'...

I'm running a service that either creates or updates objects in a GCP bucket. I.e my code checks if the object exists, and if it does my code reads it, updates it and writes it back. Occasionally I'm ...

I am trying to run a storage transfer job to copy files from a starting location bucket to a bucket in a destination location. The following code fails to rewrite starting bucket files to ...

For uploading files to google cloud buckets, i'm using JSON API. for that i crated a Bearer Token by using following commands $> gcloud auth activate-service-account myaccount@gserviceaccounts.co -...

We are trying to upload multiple files i.e. 100 or more than that to Google Cloud Storage, but we get the below error randomly. Average File Size: 30MB - 40 MB 08:57:15.488 [ForkJoinPool-1-worker-...

I am using google storage to store product images.What i want is to show no-product-image.png image in case product has no image in storage, instead of 404 error code

I have a react app where I use react-dropzone-component. When I drop images to it, I send a POST request for each image (in future bulk upload, but one step a time) on a firebase function to process ...

I'm not using App Engine. I read this page. Configure Django and Google Cloud Storage? I installed django-storages and boto. I set my setting file like this. DEFAULT_FILE_STORAGE = 'storages.backends....

I am new to Google Cloud Platform and in my whole I have been working on Python 3. I am trying to find out which version of Python is more complete for Google App Engine: Python 2.7 or Python 3. As I'...

I am using DataLab to create several dataframes and subsequent figures. I would like to save these figures to either my computer hard drive or to my Google Cloud Storage. Normally, I would do the ...

Are there any API function that allow us to move files in Google Cloud Storage from one bucket in another bucket? The scenario is we want Python to move read files in A bucket to B bucket. I knew ...

As the title, the results from "gsutil cp" doesn't redirect to stdout, it always redirect to stderr. As an example : gsutil cp existed_file.txt . > >(tee -a out.log) 2> >(tee -a error.log ...

Here is a function to load data from google cloud bucket. action_dataset_folder_path = 'action-data-set' zip_path = 'actions.zip' url='http://console.cloud.google.com/storage/browser/actions' class ...

I have a test script in codepen that should be able to fetch a file from Google storage. Instead I get CORS errors. I have several Google Storage buckets some work with the javascript fetch api, ...

As Google claims there is no support for conversion from Avro logicalType to BigQuery specific type (as described here on the bottom). However I'm able to load Avro file with the following schema: ...

I am creating a django application in hosted in google cloud. I am able to send and save data in the backend mysql database but not able to upload and save images using django's ImageField. Please ...

Related tags

Hot questions

Language

Popular Tags