Examples show how to configure JDBC Cluster and JDBC Client modes while launching the Spark shell. In a few steps, you configure Apache Spark to connect to HiveServer (HS2). Understanding execution locations and recommendations help you configure JDBC reads for your use case.
The location where your queries are executed affects configuration. You need to understand how you read Apache Hive tables from Apache Spark through HWC using the JDBC mode.
JDBC read mode is secured through Ranger authorization and supports fine-grained access control, such as column masking. JDBC read mode is a connection that Hive Warehouse Connector (HWC) makes to HiveServer (HS2) to get transaction information. You must understand the limitations of Direct Reader mode and what functionality is not supported. The Direct Reader V2 configuration processes ORC data using vectorization, which improves performance. You need to know the property names and valid values for configuring Direct Reader mode. An example shows how to configure Direct Reader reads while launching the Spark shell. In a few steps, you configure Apache Spark to connect to the Apache Hive metastore. Direct Reader mode does not support Ranger authorization. You use this mode if you do not need production-level Ranger authorization. In Direct Reader mode, Spark reads the data directly from the managed table location using the transaction snapshot. Antigua and Barbuda, Aruba, Australia, Austria, Bahamas, Bahrain, Bangladesh, Barbados, Belgium, Belize, Bermuda, Bolivia, Brunei Darussalam, Bulgaria, Cambodia, Canada, Cayman Islands, Chile, China, Colombia, Costa Rica, Croatia, Republic of, Cyprus, Czech Republic, Denmark, Dominica, Dominican Republic, Egypt, El Salvador, Estonia, Finland, France, French Guiana, Germany, Gibraltar, Greece, Grenada, Guadeloupe, Guatemala, Guernsey, Honduras, Hong Kong, Hungary, Iceland, Indonesia, Ireland, Israel, Italy, Jamaica, Japan, Jersey, Jordan, Korea, South, Kuwait, Latvia, Liechtenstein, Lithuania, Luxembourg, Macau, Malaysia, Maldives, Malta, Martinique, Monaco, Montserrat, Netherlands, New Zealand, Nicaragua, Norway, Oman, Pakistan, Panama, Paraguay, Philippines, Poland, Portugal, Qatar, Reunion, Romania, Saint Kitts-Nevis, Saint Lucia, Saudi Arabia, Singapore, Slovakia, Slovenia, South Africa, Spain, Sri Lanka, Sweden, Switzerland, Taiwan, Trinidad and Tobago, Turks and Caicos Islands, United Arab Emirates, United Kingdom, United StatesĪPO/FPO, Afghanistan, Albania, Algeria, American Samoa, Andorra, Angola, Anguilla, Argentina, Armenia, Azerbaijan Republic, Belarus, Benin, Bhutan, Bosnia and Herzegovina, Botswana, Brazil, British Virgin Islands, Burkina Faso, Burundi, Cameroon, Cape Verde Islands, Central African Republic, Chad, Comoros, Congo, Democratic Republic of the, Congo, Republic of the, Cook Islands, Côte d'Ivoire (Ivory Coast), Djibouti, Ecuador, Equatorial Guinea, Eritrea, Ethiopia, Falkland Islands (Islas Malvinas), Fiji, French Polynesia, Gabon Republic, Gambia, Georgia, Ghana, Greenland, Guam, Guinea, Guinea-Bissau, Guyana, Haiti, India, Iraq, Kazakhstan, Kenya, Kiribati, Kyrgyzstan, Laos, Lebanon, Lesotho, Liberia, Libya, Macedonia, Madagascar, Malawi, Mali, Marshall Islands, Mauritania, Mauritius, Mayotte, Mexico, Micronesia, Moldova, Mongolia, Montenegro, Morocco, Mozambique, Namibia, Nauru, Nepal, Netherlands Antilles, New Caledonia, Niger, Nigeria, Niue, Palau, Papua New Guinea, Peru, Puerto Rico, Russian Federation, Rwanda, Saint Helena, Saint Pierre and Miquelon, Saint Vincent and the Grenadines, San Marino, Senegal, Serbia, Seychelles, Sierra Leone, Solomon Islands, Somalia, Suriname, Svalbard and Jan Mayen, Swaziland, Tajikistan, Tanzania, Thailand, Togo, Tonga, Tunisia, Turkey, Turkmenistan, Tuvalu, Uganda, Ukraine, Uzbekistan, Vanuatu, Vatican City State, Venezuela, Vietnam, Virgin Islands (U.S.Direct Reader mode is a transparent connection that Hive Warehouse Connector (HWC) makes to Apache Hive metastore (HMS) to get transaction information.
0 kommentar(er)
