Caused by: org.apache.parquet.io.ParquetDecodingException: Can‘t read value in column [result, label
寫入hdfs是沒有問題,但是讀取的時候會報這個錯
Caused by: org.apache.parquet.io.ParquetDecodingException: Can't read value in column [result, label_id] INT64 at value 2678 out of 2678, 2678 out of 2678 in currentPage. repetition level: 1, definition level: 1
和這個錯
java.lang.IllegalArgumentException: Reading past RLE/BitPacking stream.
解決辦法:寫入的時候,加個配置就可以了
conf.set("spark.sql.parquet.writeLegacyFormat", "true");
如果設定為true,Spark或java將使用與Hive相同的約定來編寫Parquet資料。
相關文章
- mysql遇到Variable can’t be set to the value of ‘NULL’MySqlNull
- Mysql:Variable 'XXXt' can't be set to the value of 'NULL'解決MySqlNull
- 阿里雲 Redis 報出You can't read against a non-read redis.解決方案阿里RedisAI
- 解決問題:Variable 'time_zone' can't be set to the value of 'NULL'Null
- attempt to index local ‘result‘ (a nil value)Index
- [ERR] 1231 - Variable 'sql_mode' can't be set to the value of 'NO_AUTO_CREATE_USER'SQL
- [20231103]sqlplus column new_value old_value.txtSQL
- [20230303]sqlplus column new_value old_value.txtSQL
- MySQL報錯Table 'plugin' is read only [ERROR] Can't open the mysql.plugin table.MySqlPluginError
- pymysql.err.OperationalError: (1136, “Column count doesn‘t match value count at row 1“)報錯反省。MySqlError
- In the meantime you can read the IGN analysis of Madden 22
- TypeError: can‘t concat str to bytesError
- Can't open file: (errno: 24)
- SSM+Swagger問題解決 Can‘t read swagger JSON from http://localhost:8080/xxx/swagger/api-docsSSMSwaggerJSONHTTPlocalhostAPI
- Failed to read auto-increment value from storage engineAIREM
- Supervisor 解決 can't find command *
- Mongoose can't update timestampGo
- java.sql.BatchUpdateException: Date truncation: Out of range value for column xxxxxJavaSQLBATException
- Result Maps collection already contains value for xxx.xxx.dao.BaseResultMap錯誤AI
- GCC編譯遇到“a label can only be part of a statement and a declaration is not a statement”問題GC編譯
- eslint --fix 報錯 can't not find modulesEsLint
- MySQL 2003 - Can’t connect to MySQL server on (10060)MySqlServer
- Can't load IA 32-bit .dll on a
- multiprocessing pool AttributeError: Can't get attribute 'func'Error
- <el-table-column prop="item_no" label="料號"/>設定最小寬度
- Can GoldenGate Replicate An Oracle Table That Contains Only CLOB Column(s)? (Doc ID 971833.1)GoOracleAI
- Python——UnicodeEncodeError: 'ascii' codec can't encode/decode charactersPythonUnicodeErrorASCII
- redis : Can't save in background: fork: Cannot allocate memoryRedis
- Result Maps collection already contains value for com.xxx.xxxMapper.BaseResultMap問題解決AIAPP
- FILESTREAM feature can't be enabled if you use cluster shared volumes
- WIN配置git 配置後失敗 can't be establishedGit
- Error:Can't connect to SOCKS proxy:Connection refused (Connection refused)Error
- Python報錯:UnicodeDecodeError: 'gbk' codec can't decode byte ...PythonUnicodeError
- You can‘t specify target table ‘Person‘ for update in FROM clause
- ORA-12899: value too large for column ORG_NAME (actual: 145, maximum: 128)
- 完美解決stack Error: Can‘t find Python executable “python“, you can set the PYTHON env variable.ErrorPython
- Fatal error: can't check configuration file '/home/watt/proxy/dError
- 解決ERROR 1231 (42000): Variable 'time_zone' can'tError