/
Flashcards from Upload
Save to my account
Sign up
Flashcards from Upload
Big Data Data Science Fundamentals
Study
1
Question
What are the original three Vs that characterize big data?
Answer
Volume, Variety, Velocity
2
Question
What additional V is sometimes added to big data characteristics?
Answer
Veracity
3
Question
Which programming language is recommended for data science due to its libraries and support?
Answer
Python
4
Question
How does big data benefit commercial companies?
Answer
Insights into customers, processes, and products for personalized offerings
5
Question
What kind of data do organizations like the NSA and GCHQ analyze for surveillance?
Answer
Massive scrolls of data such as emails, messages, and location data
6
Question
What are the main types of data in data science?
Answer
Structured, Unstructured, Natural language, Machine-generated, Graph-based, Audio/video/images, Streaming
7
Question
Define structured data.
Answer
Data that depends on a data model and resides in fixed fields within records, often stored in databases or spreadsheets
8
Question
Give an example of unstructured data.
Answer
Email content
9
Question
Why is natural language data challenging to process?
Answer
It’s ambiguous and requires specialized linguistics and data science techniques
10
Question
What is machine-generated data?
Answer
Data automatically created by computers, applications, or machines without human intervention
11
Question
What is an example of graph-based data?
Answer
Social networks on platforms like Facebook, Twitter, and LinkedIn
12
Question
Why are audio, image, and video data types challenging for data scientists?
Answer
They require complex recognition algorithms and suffer from processing difficulty for computers
13
Question
What differentiates streaming data from other data types?
Answer
It flows into systems in real time when events occur, not in batch loads
14
Question
List the six steps of the data science process.
Answer
1. Setting research goal, 2. Retrieving data, 3. Data preparation, 4. Data exploration, 5. Data modeling, 6. Presentation and automation
15
Question
What is the purpose of the data science project charter?
Answer
To define goals, data needs, resources, timetable, and deliverables for the project
16
Question
What are the main subphases of data preparation?
Answer
Data cleansing, data integration, data transformation
17
Question
What is the goal of data exploration?
Answer
Understanding data interactions, distribution, and outliers using descriptive statistics and visualization
18
Question
Why is model building an iterative process?
Answer
Because it involves selecting variables, fitting models, and validating repeatedly for best results
19
Question
What is the importance of presentation and automation in data science?
Answer
To communicate insights and enable operational use or ongoing analysis
20
Question
What is the big data ecosystem?
Answer
A collection of technologies, tools, and frameworks grouped based on their goals and functionalities
21
Question
What is a distributed file system, and what is its advantage?
Answer
A file system across multiple servers that stores large files and provides scalability and redundancy
22
Question
What is an example of a distributed file system widely used today?
Answer
Hadoop Distributed File System (HDFS)
23
Question
Why do we use frameworks for distributed programming?
Answer
To manage complexities like job failures, task tracking, and data locality
24
Question
What are data integration frameworks used for?
Answer
To move and combine data from various sources, similar to ETL processes
25
Question
Why are machine learning frameworks essential in data science?
Answer
To analyze large datasets efficiently and extract insights through models
26
Question
Name two popular Python libraries for machine learning.
Answer
Scikit-learn, Pylearn2
27
Question
What are NoSQL databases designed for?
Answer
Managing and querying huge, scalable, non-relational, often unstructured data
28
Question
What are the main categories of NoSQL databases?
Answer
Column databases, Document stores, Streaming data sources, Key-value stores, Graph databases
29
Question
What is a graph database used for?
Answer
Storing and analyzing relationships and connections, such as social networks
30
Question
What makes audio, image, and video data unique in data science?
Answer
They require specialized recognition algorithms and are computationally intensive