Caused by: org.apache.parquet.io.ParquetDecodingException: Can‘t read value in column [result, label
寫入hdfs是沒有問題,但是讀取的時候會報這個錯
Caused by: org.apache.parquet.io.ParquetDecodingException: Can't read value in column [result, label_id] INT64 at value 2678 out of 2678, 2678 out of 2678 in currentPage. repetition level: 1, definition level: 1
和這個錯
java.lang.IllegalArgumentException: Reading past RLE/BitPacking stream.
解決辦法:寫入的時候,加個配置就可以了
conf.set("spark.sql.parquet.writeLegacyFormat", "true");
如果設定為true,Spark或java將使用與Hive相同的約定來編寫Parquet資料。
相關文章
- mysql遇到Variable can’t be set to the value of ‘NULL’MySqlNull
- Mysql:Variable 'XXXt' can't be set to the value of 'NULL'解決MySqlNull
- 解決問題:Variable 'time_zone' can't be set to the value of 'NULL'Null
- mysql:Variable 'character_set_client' can't be set to the value of 'NULL'解決MySqlclientNull
- Can't use function return value in write context 使用empty遇到報錯FunctionContext
- Variable 'character_set_client' can't be set to the value of Null的解決方法clientNull
- [Err] 1231 - Variable 'sql_mode' can't be set to the value of 'NULLSQLNull
- attempt to index local ‘result‘ (a nil value)Index
- 安裝mysql遇到ERROR: 1136 Column count doesn't match value count at row 1MySqlError
- mysql [ERROR] InnoDB: ./ibdata1 can't be opened in read-write modeMySqlError
- [mysql] 批量匯入提示: Variable ‘character_set_client’ can’t be set to the value of ‘NULLMySqlclientNull
- mysql匯入報錯Variable 'sql_notes' can't be set to the value of 'NULL'MySqlNull
- mysql啟動時報錯Can't read from messagefile errmsg.sysMySql
- Can't connect to X11 window server using ':0.0' as the value of the DISPLAY variable.Server
- Map all result column from TIBCO JDBC QueryJDBC
- pymysql.err.OperationalError: (1136, “Column count doesn‘t match value count at row 1“)報錯反省。MySqlError
- MySQL報錯Table 'plugin' is read only [ERROR] Can't open the mysql.plugin table.MySqlPluginError
- [ERR] 1231 - Variable 'sql_mode' can't be set to the value of 'NO_AUTO_CREATE_USER'SQL
- 阿里雲 Redis 報出You can't read against a non-read redis.解決方案阿里RedisAI
- ServeRAID mismatched software levels can result in system problemsServerAI
- rman: can't open target
- C# return dynamic/anonymous type value as function resultC#Function
- Large result cache can cause sessions to spin -instance to hangSession
- mail can't send title on SolarisAI
- datastage7.5 can't view data?ASTView
- duplicate ORA-01405: fetched column value is NULLNull
- TypeError: can‘t concat str to bytesError
- Mongoose can't update timestampGo
- [ERROR] Can't open the mysql.plugin tableErrorMySqlPlugin
- Oracle dbconsole can't startOracle
- mysql can't start dues to the disk space is fullMySql
- Failed to read auto-increment value from storage engineAIREM
- [20230303]sqlplus column new_value old_value.txtSQL
- mysql 主從同步 Error 'Out of range value for column的問題MySql主從同步Error
- GCC編譯遇到“a label can only be part of a statement and a declaration is not a statement”問題GC編譯
- 'mysql.column_stats' doesn't exist and Table 'mysql.index_stats' doesn't existMySqlIndex
- [20231103]sqlplus column new_value old_value.txtSQL
- ERROR getting 'android:label' attribute: attribute is not a string valueErrorAndroid