温馨提示:本文翻译自stackoverflow.com，查看原文请点击：其他 - How to concatenate spark dataframe columns using Spark sql in databricks
apache-spark apache-spark-sql azure-databricks

其他 - 如何在Databricks中使用Spark SQL连接Spark DataFrame列

发布于 2020-04-20 11:04:49

我在数据框中有两列分别称为“ FirstName”和“ LastName”，如何将这两列连接为一个。

  |Id  |FirstName|LastName|
  |  1 |    A    |   B    |
  |    |         |        |
  |    |         |        |

我要这样

|Id |FullName |
| 1 |    AB   |     
|   |         |       
|   |         |

我的查询看起来像这样，但是会引发错误

val kgt=spark.sql("""
Select Id,FirstName+' '+ContactLastName AS FullName from tblAA """)

kgt.createOrReplaceTempView("NameTable")

查看更多

提问者
Yonas Haile
被浏览
8
分享
venus 2020-02-05 17:38

这里我们使用Spark SQL解决方案：

spark.sql("select Id, CONCAT(FirstName,' ',LastName) as FullName from NameTable").show(false)

要么

spark.sql( " select Id, FirstName || ' ' ||LastName as FullName from NameTable ").show(false)

相关问题

1
在Spark SQL中应用to_date（）和add_months函数时出错
2
使用ArrayType列将UDF重写为pandas udf
3
如何在Spark集群上运行C算法？
4
Delta Lake的VACUUM操作是否需要始终启用Databricks集群？
5
将值添加到Spark DataFrame列中的现有嵌套json中
6
使用PySpark合并没有重复的Spark模式？
7
Pyspark：提取数据框的行，其中值包含字符串
8
具有窗口功能的PySpark数据偏度
9
如何在Apache-Spark中连接主机和从机？
10
AWS EMR上的spark-submit运行但在访问S3时失败

热门github

1
real time face swap and one-click video deepfake with only a single image
2
A quick example of how one can "synchronize" a 3d scene across multiple windows using three.js and localStorage
3
ChatGPT DAN, Jailbreaks prompt
4
21 Lessons, Get Started Building with Generative AI 🔗 https://microsoft.github.io/generative-ai-for-beginners/ (翻译：12 节课程，开始使用生成式 AI 进行构建)
5
Curated list of project-based tutorials (翻译：收藏了基于项目的教程列表)
6
Truly independent web browser
7
Python - 100天从新手到大师
8
An open source payments switch written in Rust to make payments fast, reliable and affordable (翻译：YOLOv8 🚀 in PyTorch > ONNX > CoreML > TFLite)
9
Agent S: an open agentic framework that uses computers like a human
10
Master programming by recreating your favorite technologies from scratch. (翻译：在这个项目中，你能学会如何创造自己的各种工具，引擎，游戏，框架，库......)
11
Jelly Evolution Simulator
12
Collection of leaked system prompts
13
🤯 Lobe Chat - an open-source, modern-design AI chat framework. Supports Multi AI Providers( OpenAI / Claude 3 / Gemini / Ollama / DeepSeek / Qwen), Knowledge Base (file upload / knowledge management / RAG ), Multi-Modals (Plugins/Artifacts) and Thinking. One-click FREE deployment of your private ChatGPT/ Claude / DeepSeek application. (翻译：LobeChat 是开源的高性能聊天机器人框架，支持语音合成、多模态、可扩展的（Function Call）插件系统。)