Akka（37）： Http：客户端操作模式

2024-04-09 04:48
文章标签 模式 操作 http 客户端 37 akka

本文主要是介绍Akka（37）： Http：客户端操作模式，希望对大家解决编程问题提供一定的参考价值，需要的开发者们随着小编来一起学习吧！

   Akka-http的客户端连接模式除Connection-Level和Host-Level之外还有一种非常便利的模式：Request-Level-Api。这种模式免除了连接Connection的概念，任何时候可以直接调用singleRequest来与服务端沟通。下面我们用几个例子来示范singleRequest的用法：

  (for {response <- Http().singleRequest(HttpRequest(method=HttpMethods.GET,uri="http://localhost:8011/message"))message <- Unmarshal(response.entity).to[String]} yield message).andThen {case Success(msg) => println(s"Received message: $msg")case Failure(err) => println(s"Error: ${err.getMessage}")}.andThen {case _ => sys.terminate()}

这是一个GET操作：用Http().singleRequest直接把HttpRequest发送给服务端uri并获取返回的HttpResponse。我们看到，整组函数的返回类型都是Future[?]，所以用for-comprehension来把所有实际运算包嵌在Future运算模式内（context)。下面这个例子是客户端上传数据示范： 

  (for {entity <- Marshal("Wata hell you doing?").to[RequestEntity]response <- Http().singleRequest(HttpRequest(method=HttpMethods.PUT,uri="http://localhost:8011/message",entity=entity))message <- Unmarshal(response.entity).to[String]} yield message).andThen {case Success(msg) => println(s"Received message: $msg")case Failure(err) => println(s"Error: ${err.getMessage}")}.andThen {case _ => sys.terminate()}

以上是个PUT操作。我们需要先构建数据载体HttpEntity。格式转换函数Marshal也返回Future[HttpEntity]，所以也可以包含在for语句内。关注一下这个andThen，它可以连接一串多个monadic运算，在不影响上游运算结果的情况下实现一些副作用计算。

值得注意的是上面这两个例子虽然表现形式很简洁，但我们无法对数据转换过程中的异常及response的状态码等进行监控。所以我们应该把整个过程拆分成两部分：先获取response，再具体处理response,包括核对状态，处理数据等：

  case class Item(id: Int, name: String, price: Double)def getItem(itemId: Int): Future[HttpResponse] = for {response <- Http().singleRequest(HttpRequest(method=HttpMethods.GET,uri = s"http://localhost:8011/item/$itemId"))} yield responsedef extractEntity[T](futResp: Future[HttpResponse])(implicit um: Unmarshaller[ResponseEntity,T]) = {futResp.andThen {case Success(HttpResponse(StatusCodes.OK, _, entity, _)) =>Unmarshal(entity).to[T].onComplete {case Success(t) => println(s"Got response entity: ${t}")case Failure(e) => println(s"Unmarshalling failed: ${e.getMessage}")}case Success(_) => println("Exception in response!")case Failure(err) => println(s"Response Failed: ${err.getMessage}")}}extractEntity[Item](getItem(13))

现在这个extractEntity[Item](getItem(13))可以实现全过程的监控管理了。用同样的模式实现PUT操作： 

  def putItem(item: Item): Future[HttpResponse] =for {reqEntity <- Marshal(item).to[RequestEntity]response <- Http().singleRequest(HttpRequest(method=HttpMethods.PUT,uri="http://localhost:8011/item",entity=reqEntity))} yield responseextractEntity[Item](putItem(Item(23,"Item#23", 46.0))).andThen { case _ => sys.terminate()}

当然，我们还是使用了前面几篇讨论里的Marshalling方式来进行数据格式的自动转换： 

import de.heikoseeberger.akkahttpjson4s.Json4sSupport
import org.json4s.jackson
...
trait JsonCodec extends Json4sSupport {import org.json4s.DefaultFormatsimport org.json4s.ext.JodaTimeSerializersimplicit val serilizer = jackson.Serializationimplicit val formats = DefaultFormats ++ JodaTimeSerializers.all
}
object JsConverters extends JsonCodec
...import JsConverters._implicit val jsonStreamingSupport = EntityStreamingSupport.json().withParallelMarshalling(parallelism = 8, unordered = false)

如果我们需要对数据交换过程进行更细致的管控，用Host-Level-Api会更加适合。下面我们就针对Host-Level-Api构建一个客户端的工具库： 

class PooledClient(host: String, port: Int, poolSettings: ConnectionPoolSettings)(implicit sys: ActorSystem, mat: ActorMaterializer) {import sys.dispatcherprivate val cnnPool: Flow[(HttpRequest, Int), (Try[HttpResponse], Int), Http.HostConnectionPool] =Http().cachedHostConnectionPool[Int](host = host, port = port, settings = poolSettings)
//单一requestdef requestSingleResponse(req: HttpRequest): Future[HttpResponse] = {Source.single(req -> 1).via(cnnPool).runWith(Sink.head).flatMap {case (Success(resp), _) => Future.successful(resp)case (Failure(fail), _) => Future.failed(fail)}}
//组串requestdef orderedResponses(reqs: Iterable[HttpRequest]): Future[Iterable[HttpResponse]] = {Source(reqs.zipWithIndex.toMap).via(cnnPool).runFold(SortedMap[Int, Future[HttpResponse]]()) {case (m, (Success(r), idx)) => m + (idx -> Future.successful(r))case (m, (Failure(f), idx)) => m + (idx -> Future.failed(f))}.flatMap { m => Future.sequence(m.values) }}
}

下面是一种比较安全的模式：使用了queue来暂存request从而解决因发送方与接收方速率不同所产生的问题： 

class QueuedRequestsClient(host: String, port: Int, poolSettings: ConnectionPoolSettings)(qsize: Int = 10, overflowStrategy: OverflowStrategy = OverflowStrategy.dropNew)(implicit sys: ActorSystem, mat: ActorMaterializer) {import sys.dispatcherprivate val cnnPool: Flow[(HttpRequest,Promise[HttpResponse]),(Try[HttpResponse],Promise[HttpResponse]),Http.HostConnectionPool] =Http().cachedHostConnectionPool[Promise[HttpResponse]](host=host,port=port,settings=poolSettings)val queue =Source.queue[(HttpRequest, Promise[HttpResponse])](qsize, overflowStrategy).via(cnnPool).to(Sink.foreach({case ((Success(resp), p)) => p.success(resp)case ((Failure(e), p))    => p.failure(e)})).run()def queueRequest(request: HttpRequest): Future[HttpResponse] = {val responsePromise = Promise[HttpResponse]()queue.offer(request -> responsePromise).flatMap {case QueueOfferResult.Enqueued    => responsePromise.futurecase QueueOfferResult.Dropped     => Future.failed(new RuntimeException("Queue overflowed. Try again later."))case QueueOfferResult.Failure(ex) => Future.failed(ex)case QueueOfferResult.QueueClosed => Future.failed(new RuntimeException("Queue was closed (pool shut down) while running the request. Try again later."))}}
}

下面是这些工具函数的具体使用示范： 

  val settings = ConnectionPoolSettings(sys).withMaxConnections(8).withMaxOpenRequests(8).withMaxRetries(3).withPipeliningLimit(4)val pooledClient = new PooledClient("localhost",8011,settings)def getItemByPool(itemId: Int): Future[HttpResponse] = for {response <- pooledClient.requestSingleResponse(HttpRequest(method=HttpMethods.GET,uri = s"http://localhost:8011/item/$itemId"))} yield responseextractEntity[Item](getItemByPool(13))def getItemsByPool(itemIds: List[Int]): Future[Iterable[HttpResponse]] = {val reqs = itemIds.map { id =>HttpRequest(method = HttpMethods.GET, uri = s"http://localhost:8011/item/$id")}val rets = (for {responses <- pooledClient.orderedResponses(reqs)} yield responses)rets}val futResps = getItemsByPool(List(3,5,7))futResps.andThen {case Success(listOfResps) => {listOfResps.foreach { r =>r match {case HttpResponse(StatusCodes.OK, _, entity, _) =>Unmarshal(entity).to[Item].onComplete {case Success(t) => println(s"Got response entity: ${t}")case Failure(e) => println(s"Unmarshalling failed: ${e.getMessage}")}case _ => println("Exception in response!")}}}case _ => println("Failed to get list of responses!")}val queuedClient = new QueuedRequestsClient("localhost",8011,settings)()def putItemByQueue(item: Item): Future[HttpResponse] =for {reqEntity <- Marshal(item).to[RequestEntity]response <- queuedClient.queueRequest(HttpRequest(method=HttpMethods.PUT,uri="http://localhost:8011/item",entity=reqEntity))} yield responseextractEntity[Item](putItemByQueue(Item(23,"Item#23", 46.0))).andThen { case _ => sys.terminate()}

下面是本次讨论的示范源代码：

服务端代码：

import akka.actor._
import akka.stream._
import akka.http.scaladsl.Http
import akka.http.scaladsl.server.Directives._import de.heikoseeberger.akkahttpjson4s.Json4sSupport
import org.json4s.jackson
trait JsonCodec extends Json4sSupport {import org.json4s.DefaultFormatsimport org.json4s.ext.JodaTimeSerializersimplicit val serilizer = jackson.Serializationimplicit val formats = DefaultFormats ++ JodaTimeSerializers.all
}
object JsConverters extends JsonCodecobject TestServer extends App with JsonCodec {implicit val httpSys = ActorSystem("httpSystem")implicit val httpMat = ActorMaterializer()implicit val httpEC = httpSys.dispatcherimport JsConverters._case class Item(id: Int, name: String, price: Double)val messages = path("message") {get {complete("hello, how are you?")} ~put {entity(as[String]) {msg =>complete(msg)}}}val items =(path("item" / IntNumber) & get) { id =>get {complete(Item(id, s"item#$id", id * 2.0))}} ~(path("item") & put) {entity(as[Item]) {item =>complete(item)}}val route = messages ~ itemsval (host, port) = ("localhost", 8011)val bindingFuture = Http().bindAndHandle(route,host,port)println(s"Server running at $host $port. Press any key to exit ...")scala.io.StdIn.readLine()bindingFuture.flatMap(_.unbind()).onComplete(_ => httpSys.terminate())}

客户端源代码： 

import akka.actor._
import akka.http.scaladsl.settings.ConnectionPoolSettings
import akka.stream._
import akka.stream.scaladsl._
import akka.http.scaladsl.Http
import akka.http.scaladsl.model._import scala.util._
import de.heikoseeberger.akkahttpjson4s.Json4sSupport
import org.json4s.jacksonimport scala.concurrent._
import akka.http.scaladsl.unmarshalling.Unmarshal
import akka.http.scaladsl.unmarshalling._
import akka.http.scaladsl.marshalling.Marshalimport scala.collection.SortedMap
import akka.http.scaladsl.common._trait JsonCodec extends Json4sSupport {import org.json4s.DefaultFormatsimport org.json4s.ext.JodaTimeSerializersimplicit val serilizer = jackson.Serializationimplicit val formats = DefaultFormats ++ JodaTimeSerializers.all
}
object JsConverters extends JsonCodecclass PooledClient(host: String, port: Int, poolSettings: ConnectionPoolSettings)(implicit sys: ActorSystem, mat: ActorMaterializer) {import sys.dispatcherprivate val cnnPool: Flow[(HttpRequest, Int), (Try[HttpResponse], Int), Http.HostConnectionPool] =Http().cachedHostConnectionPool[Int](host = host, port = port, settings = poolSettings)def requestSingleResponse(req: HttpRequest): Future[HttpResponse] = {Source.single(req -> 1).via(cnnPool).runWith(Sink.head).flatMap {case (Success(resp), _) => Future.successful(resp)case (Failure(fail), _) => Future.failed(fail)}}def orderedResponses(reqs: Iterable[HttpRequest]): Future[Iterable[HttpResponse]] = {Source(reqs.zipWithIndex.toMap).via(cnnPool).runFold(SortedMap[Int, Future[HttpResponse]]()) {case (m, (Success(r), idx)) => m + (idx -> Future.successful(r))case (m, (Failure(f), idx)) => m + (idx -> Future.failed(f))}.flatMap { m => Future.sequence(m.values) }}
}
class QueuedRequestsClient(host: String, port: Int, poolSettings: ConnectionPoolSettings)(qsize: Int = 10, overflowStrategy: OverflowStrategy = OverflowStrategy.dropNew)(implicit sys: ActorSystem, mat: ActorMaterializer) {import sys.dispatcherprivate val cnnPool: Flow[(HttpRequest,Promise[HttpResponse]),(Try[HttpResponse],Promise[HttpResponse]),Http.HostConnectionPool] =Http().cachedHostConnectionPool[Promise[HttpResponse]](host=host,port=port,settings=poolSettings)val queue =Source.queue[(HttpRequest, Promise[HttpResponse])](qsize, overflowStrategy).via(cnnPool).to(Sink.foreach({case ((Success(resp), p)) => p.success(resp)case ((Failure(e), p))    => p.failure(e)})).run()def queueRequest(request: HttpRequest): Future[HttpResponse] = {val responsePromise = Promise[HttpResponse]()queue.offer(request -> responsePromise).flatMap {case QueueOfferResult.Enqueued    => responsePromise.futurecase QueueOfferResult.Dropped     => Future.failed(new RuntimeException("Queue overflowed. Try again later."))case QueueOfferResult.Failure(ex) => Future.failed(ex)case QueueOfferResult.QueueClosed => Future.failed(new RuntimeException("Queue was closed (pool shut down) while running the request. Try again later."))}}
}
object ClientRequesting extends App {import JsConverters._implicit val sys = ActorSystem("sysClient")implicit val mat = ActorMaterializer()implicit val ec = sys.dispatcherimplicit val jsonStreamingSupport = EntityStreamingSupport.json().withParallelMarshalling(parallelism = 8, unordered = false)case class Item(id: Int, name: String, price: Double)def extractEntity[T](futResp: Future[HttpResponse])(implicit um: Unmarshaller[ResponseEntity,T]) = {futResp.andThen {case Success(HttpResponse(StatusCodes.OK, _, entity, _)) =>Unmarshal(entity).to[T].onComplete {case Success(t) => println(s"Got response entity: ${t}")case Failure(e) => println(s"Unmarshalling failed: ${e.getMessage}")}case Success(_) => println("Exception in response!")case Failure(err) => println(s"Response Failed: ${err.getMessage}")}}(for {response <- Http().singleRequest(HttpRequest(method=HttpMethods.GET,uri="http://localhost:8011/message"))message <- Unmarshal(response.entity).to[String]} yield message).andThen {case Success(msg) => println(s"Received message: $msg")case Failure(err) => println(s"Error: ${err.getMessage}")}  //.andThen {case _ => sys.terminate()}(for {entity <- Marshal("Wata hell you doing?").to[RequestEntity]response <- Http().singleRequest(HttpRequest(method=HttpMethods.PUT,uri="http://localhost:8011/message",entity=entity))message <- Unmarshal(response.entity).to[String]} yield message).andThen {case Success(msg) => println(s"Received message: $msg")case Failure(err) => println(s"Error: ${err.getMessage}")} //.andThen {case _ => sys.terminate()}def getItem(itemId: Int): Future[HttpResponse] = for {response <- Http().singleRequest(HttpRequest(method=HttpMethods.GET,uri = s"http://localhost:8011/item/$itemId"))} yield responseextractEntity[Item](getItem(13))def putItem(item: Item): Future[HttpResponse] =for {reqEntity <- Marshal(item).to[RequestEntity]response <- Http().singleRequest(HttpRequest(method=HttpMethods.PUT,uri="http://localhost:8011/item",entity=reqEntity))} yield responseextractEntity[Item](putItem(Item(23,"Item#23", 46.0))).andThen { case _ => sys.terminate()}val settings = ConnectionPoolSettings(sys).withMaxConnections(8).withMaxOpenRequests(8).withMaxRetries(3).withPipeliningLimit(4)val pooledClient = new PooledClient("localhost",8011,settings)def getItemByPool(itemId: Int): Future[HttpResponse] = for {response <- pooledClient.requestSingleResponse(HttpRequest(method=HttpMethods.GET,uri = s"http://localhost:8011/item/$itemId"))} yield responseextractEntity[Item](getItemByPool(13))def getItemsByPool(itemIds: List[Int]): Future[Iterable[HttpResponse]] = {val reqs = itemIds.map { id =>HttpRequest(method = HttpMethods.GET, uri = s"http://localhost:8011/item/$id")}val rets = (for {responses <- pooledClient.orderedResponses(reqs)} yield responses)rets}val futResps = getItemsByPool(List(3,5,7))futResps.andThen {case Success(listOfResps) => {listOfResps.foreach { r =>r match {case HttpResponse(StatusCodes.OK, _, entity, _) =>Unmarshal(entity).to[Item].onComplete {case Success(t) => println(s"Got response entity: ${t}")case Failure(e) => println(s"Unmarshalling failed: ${e.getMessage}")}case _ => println("Exception in response!")}}}case _ => println("Failed to get list of responses!")}val queuedClient = new QueuedRequestsClient("localhost",8011,settings)()def putItemByQueue(item: Item): Future[HttpResponse] =for {reqEntity <- Marshal(item).to[RequestEntity]response <- queuedClient.queueRequest(HttpRequest(method=HttpMethods.PUT,uri="http://localhost:8011/item",entity=reqEntity))} yield responseextractEntity[Item](putItemByQueue(Item(23,"Item#23", 46.0))).andThen { case _ => sys.terminate()}}






这篇关于Akka（37）： Http：客户端操作模式的文章就介绍到这儿，希望我们推荐的文章对编程师们有所帮助！


http://www.chinasem.cn/article/887205。

相关文章

Redis Cluster模式配置

Redis Cluster模式配置

《RedisCluster模式配置》：本文主要介绍RedisCluster模式配置,本文给大家介绍的非常详细,对大家的学习或工作具有一定的参考借鉴价值,需要的朋友参考下吧... 目录分片 一、分片的本质与核心价值二、分片实现方案对比 ‌三、分片算法详解1. ‌范围分片（顺序分片）‌2. ‌哈希分片3. ‌虚
阅读更多...
Maven 配置中的 ＜mirror＞绕过 HTTP 阻断机制的方法

Maven 配置中的 ＜mirror＞绕过 HTTP 阻断机制的方法

《Maven配置中的＜mirror＞绕过HTTP阻断机制的方法》：本文主要介绍Maven配置中的＜mirror＞绕过HTTP阻断机制的方法,本文给大家分享问题原因及解决方案,感兴趣的朋友一... 目录一、问题场景：升级 Maven 后构建失败二、解决方案：通过 <mirror> 配置覆盖默认行为1. 配置示
阅读更多...
SQL中JOIN操作的条件使用总结与实践

SQL中JOIN操作的条件使用总结与实践

《SQL中JOIN操作的条件使用总结与实践》在SQL查询中,JOIN操作是多表关联的核心工具,本文将从原理,场景和最佳实践三个方面总结JOIN条件的使用规则,希望可以帮助开发者精准控制查询逻辑... 目录一、ON与WHERE的本质区别二、场景化条件使用规则三、最佳实践建议1.优先使用ON条件2.WHERE用
阅读更多...
MYSQL查询结果实现发送给客户端

MYSQL查询结果实现发送给客户端

《MYSQL查询结果实现发送给客户端》：本文主要介绍MYSQL查询结果实现发送给客户端方式,具有很好的参考价值,希望对大家有所帮助,如有错误或未考虑完全的地方,望不吝赐教... 目录mysql取数据和发数据的流程（边读边发）Sending to clientSending DataLRU(Least Rec
阅读更多...
Linux链表操作方式

Linux链表操作方式

《Linux链表操作方式》：本文主要介绍Linux链表操作方式,具有很好的参考价值,希望对大家有所帮助,如有错误或未考虑完全的地方,望不吝赐教... 目录一、链表基础概念与内核链表优势二、内核链表结构与宏解析三、内核链表的优点四、用户态链表示例五、双向循环链表在内核中的实现优势六、典型应用场景七、调试技巧与
阅读更多...
Java Multimap实现类与操作的具体示例

Java Multimap实现类与操作的具体示例

《JavaMultimap实现类与操作的具体示例》Multimap出现在Google的Guava库中,它为Java提供了更加灵活的集合操作,：本文主要介绍JavaMultimap实现类与操作的... 目录一、Multimap 概述Multimap 主要特点：二、Multimap 实现类1. ListMult
阅读更多...
Linux中修改Apache HTTP Server(httpd)默认端口的完整指南

Linux中修改Apache HTTP Server(httpd)默认端口的完整指南

《Linux中修改ApacheHTTPServer(httpd)默认端口的完整指南》ApacheHTTPServer（简称httpd）是Linux系统中最常用的Web服务器之一,本文将详细介绍如何... 目录一、修改 httpd 默认端口的步骤1. 查找 httpd 配置文件路径2. 编辑配置文件3. 保存
阅读更多...
Python FastMCP构建MCP服务端与客户端的详细步骤

Python FastMCP构建MCP服务端与客户端的详细步骤

《PythonFastMCP构建MCP服务端与客户端的详细步骤》MCP（Multi-ClientProtocol）是一种用于构建可扩展服务的通信协议框架,本文将使用FastMCP搭建一个支持St... 目录简介环境准备服务端实现（server.py）客户端实现（client.py）运行效果扩展方向常见问题结
阅读更多...
Python中文件读取操作漏洞深度解析与防护指南

Python中文件读取操作漏洞深度解析与防护指南

《Python中文件读取操作漏洞深度解析与防护指南》在Web应用开发中,文件操作是最基础也最危险的功能之一,这篇文章将全面剖析Python环境中常见的文件读取漏洞类型,成因及防护方案,感兴趣的小伙伴可... 目录引言一、静态资源处理中的路径穿越漏洞1.1 典型漏洞场景1.2 os.path.join()的陷
阅读更多...
Python使用Code2flow将代码转化为流程图的操作教程

Python使用Code2flow将代码转化为流程图的操作教程

《Python使用Code2flow将代码转化为流程图的操作教程》Code2flow是一款开源工具,能够将代码自动转换为流程图,该工具对于代码审查、调试和理解大型代码库非常有用,在这篇博客中,我们将深... 目录引言1nVflRA、为什么选择 Code2flow？2、安装 Code2flow3、基本功能演示
阅读更多...

Copyright China编程 23002807@qq.com

沪ICP备2023033072号-2