Main Menu 56% Complete! Section 13: BigQuery Command Line 58. Introduction https://www.udemy.com/course/bigquery/learn/lecture/22981032#overview Overview 59. Cloud SDK Setup 60. BQ Basic commands 61. BQ Querying commands 62. BQ Dataset creation command 63. BQ Create all types of tables 64. BQ Load data into table 65. BQ Exclusive operations Assignment 3 ..
Category : BigQuery for Big Data Engineers
Main Menu 50% Complete!! Section 12: Materialized Views in BigQuery 51. What are Materialized Views https://www.udemy.com/course/bigquery/learn/lecture/22758503#overview Materialized Views Stored physically on disk These do occupy space and you will be charged They do not rely on the base table unless you re-run or refresh the view query Must be in the same Dataset at the ..
Main Menu Section 11: Views in BigQuery 47. Introduction to Views & their Advantages https://www.udemy.com/course/bigquery/learn/lecture/22757841#questions View Overview Views do not contain any data of its own Can be created by selecting any number of rows or columns of it base table/tables Views can reflect the results of a JOIN query on any number of tables. ..
Main Menu Section 10: Loading and Querying External Data Sources 44. Introduction and Create Cloud Storage Bucket https://www.udemy.com/course/bigquery/learn/lecture/22899018#questions Sources Querying data does not require that the data is loaded into BQ Public datasets Shared datasets External sources You can also use federated queries to query data where it resides Other situations require that the data ..
Main Menu Section 9: Clustered Tables in BigQuery 40. What is Clustering https://www.udemy.com/course/bigquery/learn/lecture/22755755#questions Clustered tables aka Bucketing in Hive Further break down Partitioned Tables Work best for very large unpartitioned databases, or very large partitions. When a table or partitions is bucketed on a column, all data in that row will be moved to that ..
Main Menu Section 8: Partitioned Tables in BigQuery 33. What is Partitioning and its benefits https://www.udemy.com/course/bigquery/learn/lecture/22751511#questions Partition Tables Special tables divided into segments, called partitions, based on specific criteria. Queries can be performed on these partitions, reducing the scan size. Makes table management easy Enhances query performance Cost effective Group the data and put an ..
Main Menu Section 7: Execution Plan of BigQuery 31. How BQ creates execution plan of a query How does BQ decide what order to process query statements What processes need to be performed before others What processes can be ran in parallel This is similar to EXPLAIN statements Example: This query calculates the total scores ..
Main Menu Section 6: BQFBD – Operations on Datasets & Tables 27. Copying Datasets https://www.udemy.com/course/bigquery/learn/lecture/22736223#questions Access You cannot grant permissions on: Tables views row level You can grant permissions on dataset level columns BQ Column-level Security Granting Access Dataset > Share dataset Enter the user or group and select the role Copying Datasets Once created, ..
Main Menu Section 5: Efficient Schema Design in BigQuery 25. Design an Efficient schema for BigQuery Tables https://www.udemy.com/course/bigquery/learn/lecture/22735695#questions Nested and Repeated Columns Works best when denormalized Rather than preserving relational schema, such as star or snowflake Normalization Technique to eliminate redundant data to minimize the insertion, deletion and update anomalies Saves a lot of space ..
Main Menu Section 4: Using BigQuery Dashboard options 19. Running queries with various query settings https://www.udemy.com/course/bigquery/learn/lecture/22729977#questions Select top 10 male names from the table select name, count from `PROJECT.DATASET.TABLE` where gender = “M” order by count desc limit 10 Notes: “PROJECT.DATASET.TABLE” are enclosed in back tics (below the ~). Often these get converted to single ..
Recent Comments