{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":71932349,"defaultBranch":"master","name":"ray","ownerLogin":"ray-project","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2016-10-25T19:38:30.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/22125274?v=4","public":true,"private":false,"isOrgOwned":true},"refInfo":{"name":"","listCacheKey":"v0:1718063442.0","currentOid":""},"activityList":{"items":[{"before":"8564dec0be5832422bfd8d57fecb3b51165b01c3","after":"25c7d7a30a36bde35724b7d78594dc1151cf31cd","ref":"refs/heads/master","pushedAt":"2024-06-11T00:13:33.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"angelinalg","name":null,"path":"/angelinalg","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/122562471?s=80&v=4"},"commit":{"message":"Update Nav Link to be \"Try Ray on Anyscale\" (#45851)\n\n<!-- Thank you for your contribution! Please review\r\nhttps://github.com/ray-project/ray/blob/master/CONTRIBUTING.rst before\r\nopening a pull request. -->\r\n\r\n<!-- Please add a reviewer to the assignee section when you create a PR.\r\nIf you don't have the access to it, we will shortly find a reviewer and\r\nassign them to your PR. -->\r\n\r\n## Why are these changes needed?\r\n\r\n<!-- Please give a short summary of the change and the problem this\r\nsolves. -->\r\n\r\n## Related issue number\r\n\r\n<!-- For example: \"Closes #1234\" -->\r\n\r\n## Checks\r\n\r\n- [ ] I've signed off every commit(by using the -s flag, i.e., `git\r\ncommit -s`) in this PR.\r\n- [ ] I've run `scripts/format.sh` to lint the changes in this PR.\r\n- [ ] I've included any doc changes needed for\r\nhttps://docs.ray.io/en/master/.\r\n- [ ] I've added any new APIs to the API Reference. For example, if I\r\nadded a\r\nmethod in Tune, I've added it in `doc/source/tune/api/` under the\r\n           corresponding `.rst` file.\r\n- [ ] I've made sure the tests are passing. Note that there might be a\r\nfew flaky tests, see the recent failures at https://flakey-tests.ray.io/\r\n- Testing Strategy\r\n   - [ ] Unit tests\r\n   - [ ] Release tests\r\n   - [ ] This PR is not tested :(\r\n\r\nSigned-off-by: Chris Zhang <chris@anyscale.com>","shortMessageHtmlLink":"Update Nav Link to be \"Try Ray on Anyscale\" (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2344972301\" data-permission-text=\"Title is private\" data-url=\"https://github.com/ray-project/ray/issues/45851\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/ray-project/ray/pull/45851/hovercard\" href=\"https://github.com/ray-project/ray/pull/45851\">#45851</a>)"}},{"before":"a78541cd13d607e022a81a6f12405d8bdde6f2ea","after":null,"ref":"refs/heads/lonnie-240610-wheelenv","pushedAt":"2024-06-10T23:50:42.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"aslonnie","name":"Lonnie Liu","path":"/aslonnie","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/95255098?s=80&v=4"}},{"before":"f9d9a873412773098d3a6fa43ed6b1a25a5f5d65","after":"8564dec0be5832422bfd8d57fecb3b51165b01c3","ref":"refs/heads/master","pushedAt":"2024-06-10T23:50:41.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"aslonnie","name":"Lonnie Liu","path":"/aslonnie","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/95255098?s=80&v=4"},"commit":{"message":"[wheel] provide a valid default commit (#45842)\n\nand only build one wheel, aligning with CI's behavior.\r\n\r\nSigned-off-by: Lonnie Liu <lonnie@anyscale.com>","shortMessageHtmlLink":"[wheel] provide a valid default commit (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2344654253\" data-permission-text=\"Title is private\" data-url=\"https://github.com/ray-project/ray/issues/45842\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/ray-project/ray/pull/45842/hovercard\" href=\"https://github.com/ray-project/ray/pull/45842\">#45842</a>)"}},{"before":"7b9ad0008b9c8701a83455d8a04c34bfcc6c12ad","after":"25280944820f5b306569f2a0e0fb6d47e6f5f0d3","ref":"refs/heads/lonnie-240517-ubuntup","pushedAt":"2024-06-10T23:00:50.000Z","pushType":"push","commitsCount":10,"pusher":{"login":"aslonnie","name":"Lonnie Liu","path":"/aslonnie","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/95255098?s=80&v=4"},"commit":{"message":"Merge remote-tracking branch 'origin/master' into lonnie-240517-ubuntup","shortMessageHtmlLink":"Merge remote-tracking branch 'origin/master' into lonnie-240517-ubuntup"}},{"before":"58d4285f5e51f195632ae8ea393dc241a1f65de2","after":"f044a75f29a83f00ba6fcedcd422f8f6fefe2890","ref":"refs/heads/lonnie-240606-cudaup","pushedAt":"2024-06-10T22:28:11.000Z","pushType":"push","commitsCount":12,"pusher":{"login":"aslonnie","name":"Lonnie Liu","path":"/aslonnie","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/95255098?s=80&v=4"},"commit":{"message":"Merge branch 'master' into lonnie-240606-cudaup","shortMessageHtmlLink":"Merge branch 'master' into lonnie-240606-cudaup"}},{"before":"681155ac8bb023c075ab80dd69ce6dadd4f22e86","after":"ab0bf7eb3c4296e76b5c2aa3a1015636f6b45648","ref":"refs/heads/lonnie-240610-fmtup","pushedAt":"2024-06-10T22:27:16.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"aslonnie","name":"Lonnie Liu","path":"/aslonnie","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/95255098?s=80&v=4"},"commit":{"message":"[lint] upgrade flake8 and isort\n\nSigned-off-by: Lonnie Liu <lonnie@anyscale.com>","shortMessageHtmlLink":"[lint] upgrade flake8 and isort"}},{"before":"12b184f6b37618d89ae0ea883f7cc3148e0c3271","after":"a78541cd13d607e022a81a6f12405d8bdde6f2ea","ref":"refs/heads/lonnie-240610-wheelenv","pushedAt":"2024-06-10T22:21:50.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"aslonnie","name":"Lonnie Liu","path":"/aslonnie","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/95255098?s=80&v=4"},"commit":{"message":"[wheel] provide a valid default commit\n\naligning with CI behavior\n\nSigned-off-by: Lonnie Liu <lonnie@anyscale.com>","shortMessageHtmlLink":"[wheel] provide a valid default commit"}},{"before":"80a6dcff7a25940ac1202e17f290fcc4a349e2b8","after":"12b184f6b37618d89ae0ea883f7cc3148e0c3271","ref":"refs/heads/lonnie-240610-wheelenv","pushedAt":"2024-06-10T22:20:09.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"aslonnie","name":"Lonnie Liu","path":"/aslonnie","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/95255098?s=80&v=4"},"commit":{"message":"[wheel] provide a valid default commit\n\naligning with CI behavior\n\nSigned-off-by: Lonnie Liu <lonnie@anyscale.com>","shortMessageHtmlLink":"[wheel] provide a valid default commit"}},{"before":"427514294b52a996b1a3cde6b9192f37fd950395","after":"80a6dcff7a25940ac1202e17f290fcc4a349e2b8","ref":"refs/heads/lonnie-240610-wheelenv","pushedAt":"2024-06-10T22:18:31.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"aslonnie","name":"Lonnie Liu","path":"/aslonnie","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/95255098?s=80&v=4"},"commit":{"message":"[wheel] provide a valid default commit\n\naligning with CI behavior\n\nSigned-off-by: Lonnie Liu <lonnie@anyscale.com>","shortMessageHtmlLink":"[wheel] provide a valid default commit"}},{"before":"02ae9ef5a18357d01a26df9d3ad2f2e591651c55","after":null,"ref":"refs/heads/lonnie-240607-gpubase","pushedAt":"2024-06-10T22:16:22.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"aslonnie","name":"Lonnie Liu","path":"/aslonnie","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/95255098?s=80&v=4"}},{"before":"19ca3c4378aee1954b6d422c01516d76855d079a","after":"f9d9a873412773098d3a6fa43ed6b1a25a5f5d65","ref":"refs/heads/master","pushedAt":"2024-06-10T22:16:21.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"aslonnie","name":"Lonnie Liu","path":"/aslonnie","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/95255098?s=80&v=4"},"commit":{"message":"[image] update build docker script's python version and gpu base (#45811)\n\nusing the ones that are currently being used in releases.\r\n\r\nalso removes flags that are not supported.\r\n\r\nSigned-off-by: Lonnie Liu <lonnie@anyscale.com>","shortMessageHtmlLink":"[image] update build docker script's python version and gpu base (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2341194446\" data-permission-text=\"Title is private\" data-url=\"https://github.com/ray-project/ray/issues/45811\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/ray-project/ray/pull/45811/hovercard\" href=\"https://github.com/ray-project/ray/pull/45811\">#45811</a>"}},{"before":"84379cfe7d6a217848e30d56ffac0bcd5e13c857","after":"19ca3c4378aee1954b6d422c01516d76855d079a","ref":"refs/heads/master","pushedAt":"2024-06-10T22:15:57.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"aslonnie","name":"Lonnie Liu","path":"/aslonnie","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/95255098?s=80&v=4"},"commit":{"message":"[wheel] remove py38 in build wheel script (#45840)\n\npy38 is gone and it is not buildable\r\n\r\nSigned-off-by: Lonnie Liu <lonnie@anyscale.com>","shortMessageHtmlLink":"[wheel] remove py38 in build wheel script (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2344646030\" data-permission-text=\"Title is private\" data-url=\"https://github.com/ray-project/ray/issues/45840\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/ray-project/ray/pull/45840/hovercard\" href=\"https://github.com/ray-project/ray/pull/45840\">#45840</a>)"}},{"before":"6b75cb43a82e76c5f4bc156dc56bb65e35cb2060","after":null,"ref":"refs/heads/lonnie-240610-no38","pushedAt":"2024-06-10T22:15:57.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"aslonnie","name":"Lonnie Liu","path":"/aslonnie","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/95255098?s=80&v=4"}},{"before":null,"after":"681155ac8bb023c075ab80dd69ce6dadd4f22e86","ref":"refs/heads/lonnie-240610-fmtup","pushedAt":"2024-06-10T19:35:04.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"aslonnie","name":"Lonnie Liu","path":"/aslonnie","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/95255098?s=80&v=4"},"commit":{"message":"[lint] upgrade flake8 and isort\n\nSigned-off-by: Lonnie Liu <lonnie@anyscale.com>","shortMessageHtmlLink":"[lint] upgrade flake8 and isort"}},{"before":"e0613ab9a1696d3551aa70c6c022b525fd8bb244","after":"427514294b52a996b1a3cde6b9192f37fd950395","ref":"refs/heads/lonnie-240610-wheelenv","pushedAt":"2024-06-10T19:22:13.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"aslonnie","name":"Lonnie Liu","path":"/aslonnie","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/95255098?s=80&v=4"},"commit":{"message":"[wheel] provide a valid default commit\n\naligning with CI behavior\n\nSigned-off-by: Lonnie Liu <lonnie@anyscale.com>","shortMessageHtmlLink":"[wheel] provide a valid default commit"}},{"before":"02dd6083c9039a350f5e8b361cc393a1af37e0b8","after":"84379cfe7d6a217848e30d56ffac0bcd5e13c857","ref":"refs/heads/master","pushedAt":"2024-06-10T19:20:10.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"shrekris-anyscale","name":null,"path":"/shrekris-anyscale","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/92341594?s=80&v=4"},"commit":{"message":"[Serve] Remove `object_store_memory` from Ray Serve (#45814)\n\n<!-- Thank you for your contribution! Please review\r\nhttps://github.com/ray-project/ray/blob/master/CONTRIBUTING.rst before\r\nopening a pull request. -->\r\n\r\n<!-- Please add a reviewer to the assignee section when you create a PR.\r\nIf you don't have the access to it, we will shortly find a reviewer and\r\nassign them to your PR. -->\r\n\r\n## Why are these changes needed?\r\n\r\n<!-- Please give a short summary of the change and the problem this\r\nsolves. -->\r\n\r\nThis change removes the `object_store_memory` option from\r\n`ray_actor_options`. Ray Core doesn't support setting\r\n`object_store_memory` at the task or actor level, so it's not meaningful\r\nto set it in a Serve deployment.\r\n\r\nNote that #45321 has affected Serve since at least as far back as Ray\r\n2.7, so `object_store_memory` hasn't been available in Serve recently\r\nanyways.\r\n\r\n## Related issue number\r\n\r\n<!-- For example: \"Closes #1234\" -->\r\n\r\nCloses #45321\r\n\r\n## Checks\r\n\r\n- [X] I've signed off every commit(by using the -s flag, i.e., `git\r\ncommit -s`) in this PR.\r\n- [X] I've run `scripts/format.sh` to lint the changes in this PR.\r\n- [ ] I've included any doc changes needed for\r\nhttps://docs.ray.io/en/master/.\r\n- [ ] I've added any new APIs to the API Reference. For example, if I\r\nadded a\r\nmethod in Tune, I've added it in `doc/source/tune/api/` under the\r\n           corresponding `.rst` file.\r\n- [ ] I've made sure the tests are passing. Note that there might be a\r\nfew flaky tests, see the recent failures at https://flakey-tests.ray.io/\r\n- Testing Strategy\r\n   - [ ] Unit tests\r\n   - [ ] Release tests\r\n   - [ ] This PR is not tested :(\r\n\r\nSigned-off-by: Shreyas Krishnaswamy <shrekris@anyscale.com>","shortMessageHtmlLink":"[Serve] Remove <code>object_store_memory</code> from Ray Serve (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2341267303\" data-permission-text=\"Title is private\" data-url=\"https://github.com/ray-project/ray/issues/45814\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/ray-project/ray/pull/45814/hovercard\" href=\"https://github.com/ray-project/ray/pull/45814\">#45814</a>)"}},{"before":"e80471c0eadb0b8c627754452f90deb7682d9500","after":"e0613ab9a1696d3551aa70c6c022b525fd8bb244","ref":"refs/heads/lonnie-240610-wheelenv","pushedAt":"2024-06-10T19:14:53.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"aslonnie","name":"Lonnie Liu","path":"/aslonnie","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/95255098?s=80&v=4"},"commit":{"message":"[wheel] provide a valid default commit\n\naligning with CI behavior\n\nSigned-off-by: Lonnie Liu <lonnie@anyscale.com>","shortMessageHtmlLink":"[wheel] provide a valid default commit"}},{"before":null,"after":"e80471c0eadb0b8c627754452f90deb7682d9500","ref":"refs/heads/lonnie-240610-wheelenv","pushedAt":"2024-06-10T19:14:16.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"aslonnie","name":"Lonnie Liu","path":"/aslonnie","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/95255098?s=80&v=4"},"commit":{"message":"[wheel] provide a valid default commit\n\naligning with CI behavior","shortMessageHtmlLink":"[wheel] provide a valid default commit"}},{"before":null,"after":"3c5d3b456b5ef4ff39f61e308a0025ca8d8e74ca","ref":"refs/heads/can-api01","pushedAt":"2024-06-10T19:10:52.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"can-anyscale","name":"Cuong Nguyen","path":"/can-anyscale","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/128072568?s=80&v=4"},"commit":{"message":"[doc][api] remove deprecated api\n\nSigned-off-by: can <can@anyscale.com>","shortMessageHtmlLink":"[doc][api] remove deprecated api"}},{"before":"d8d4c08504640c51a15244964a6a0e6dfc3c6b23","after":"6b75cb43a82e76c5f4bc156dc56bb65e35cb2060","ref":"refs/heads/lonnie-240610-no38","pushedAt":"2024-06-10T19:08:57.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"aslonnie","name":"Lonnie Liu","path":"/aslonnie","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/95255098?s=80&v=4"},"commit":{"message":"[wheel] remove py38 in build wheel script\n\npy38 is gone and it is not buildable\n\nSigned-off-by: Lonnie Liu <lonnie@anyscale.com>","shortMessageHtmlLink":"[wheel] remove py38 in build wheel script"}},{"before":null,"after":"d8d4c08504640c51a15244964a6a0e6dfc3c6b23","ref":"refs/heads/lonnie-240610-no38","pushedAt":"2024-06-10T19:08:49.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"aslonnie","name":"Lonnie Liu","path":"/aslonnie","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/95255098?s=80&v=4"},"commit":{"message":"[wheel] remove py38 in build wheel script\n\npy38 is gone and it is not buildable","shortMessageHtmlLink":"[wheel] remove py38 in build wheel script"}},{"before":null,"after":"d610c506164fdcde6d3e43e6ed7d02f90c4715a3","ref":"refs/heads/can-fix-rllib","pushedAt":"2024-06-10T18:32:30.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"can-anyscale","name":"Cuong Nguyen","path":"/can-anyscale","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/128072568?s=80&v=4"},"commit":{"message":"[rllib] uninstall tensorflow + tensorflow_probabily before reinstall\n\nSigned-off-by: can <can@anyscale.com>","shortMessageHtmlLink":"[rllib] uninstall tensorflow + tensorflow_probabily before reinstall"}},{"before":"42a2615a90aa3653f56c391538f6e004fdf877fd","after":null,"ref":"refs/heads/can-rel01","pushedAt":"2024-06-10T18:28:22.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"can-anyscale","name":"Cuong Nguyen","path":"/can-anyscale","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/128072568?s=80&v=4"}},{"before":"73570767bc8b219d090a9667903b353209628655","after":"02dd6083c9039a350f5e8b361cc393a1af37e0b8","ref":"refs/heads/master","pushedAt":"2024-06-10T18:28:21.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"can-anyscale","name":"Cuong Nguyen","path":"/can-anyscale","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/128072568?s=80&v=4"},"commit":{"message":"[ci][release] add `RAY_BACKEND_LOG_JSON` env for all release test (#45762)\n\nAdd `RAY_BACKEND_LOG_JSON` as an cluster environment to all release\r\ntests; requested by @jjyao\r\n\r\nSigned-off-by: can <can@anyscale.com>\r\nCo-authored-by: Jiajun Yao <jeromeyjj@gmail.com>","shortMessageHtmlLink":"[ci][release] add <code>RAY_BACKEND_LOG_JSON</code> env for all release test (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2336672029\" data-permission-text=\"Title is private\" data-url=\"https://github.com/ray-project/ray/issues/45762\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/ray-project/ray/pull/45762/hovercard\" href=\"https://github.com/ray-project/ray/pull/45762\">#4…</a>"}},{"before":"9ff30c8610b21b6474555b32199b5d837471e112","after":"73570767bc8b219d090a9667903b353209628655","ref":"refs/heads/master","pushedAt":"2024-06-10T18:15:56.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"jjyao","name":"Jiajun Yao","path":"/jjyao","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/898023?s=80&v=4"},"commit":{"message":"[spark] Fix error message in `_calc_mem_per_ray_node` (#45828)\n\nSigned-off-by: Weichen Xu <weichen.xu@databricks.com>","shortMessageHtmlLink":"[spark] Fix error message in <code>_calc_mem_per_ray_node</code> (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2343852507\" data-permission-text=\"Title is private\" data-url=\"https://github.com/ray-project/ray/issues/45828\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/ray-project/ray/pull/45828/hovercard\" href=\"https://github.com/ray-project/ray/pull/45828\">#45828</a>)"}},{"before":"5452d0b33ad721ff5f030cd8c13f532c68483827","after":"9ff30c8610b21b6474555b32199b5d837471e112","ref":"refs/heads/master","pushedAt":"2024-06-10T18:15:00.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"jjyao","name":"Jiajun Yao","path":"/jjyao","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/898023?s=80&v=4"},"commit":{"message":"[Spark] Remove pricing warning when starting cluster (#45830)\n\nSigned-off-by: Ben Wilson <benjamin.wilson@databricks.com>","shortMessageHtmlLink":"[Spark] Remove pricing warning when starting cluster (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2344191602\" data-permission-text=\"Title is private\" data-url=\"https://github.com/ray-project/ray/issues/45830\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/ray-project/ray/pull/45830/hovercard\" href=\"https://github.com/ray-project/ray/pull/45830\">#45830</a>)"}},{"before":"2bb18d1767a6f76af2027efa19bf896d89057085","after":"5452d0b33ad721ff5f030cd8c13f532c68483827","ref":"refs/heads/master","pushedAt":"2024-06-10T18:07:12.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"edoakes","name":"Edward Oakes","path":"/edoakes","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9871461?s=80&v=4"},"commit":{"message":"[Serve] create internal request id to track request objects (#45761)\n\n<!-- Thank you for your contribution! Please review\r\nhttps://github.com/ray-project/ray/blob/master/CONTRIBUTING.rst before\r\nopening a pull request. -->\r\n\r\n<!-- Please add a reviewer to the assignee section when you create a PR.\r\nIf you don't have the access to it, we will shortly find a reviewer and\r\nassign them to your PR. -->\r\n\r\n## Why are these changes needed?\r\n\r\nUser found an issue where when the request id is reused by multiple\r\nrequests around the same time, Serve's proxy will be unable to track the\r\nrequest objects correctly. We should not rely on client's request id to\r\nbe unique during their lifecycle. This PR added a new\r\n`internal_request_id` on the `RequestMetadata`, randomly generated by\r\nthe proxy, to track the request object. Client passed `request_id`\r\ncontinues to be set on the `RequestMetadata` and be used for logging.\r\nAlso, updated the doc on the request id to make it more clear on what\r\nhappens when it's re-used.\r\n\r\n## Related issue number\r\n\r\nCloses https://github.com/ray-project/ray/issues/45723\r\n\r\n## Checks\r\n\r\n- [ ] I've signed off every commit(by using the -s flag, i.e., `git\r\ncommit -s`) in this PR.\r\n- [ ] I've run `scripts/format.sh` to lint the changes in this PR.\r\n- [ ] I've included any doc changes needed for\r\nhttps://docs.ray.io/en/master/.\r\n- [ ] I've added any new APIs to the API Reference. For example, if I\r\nadded a\r\nmethod in Tune, I've added it in `doc/source/tune/api/` under the\r\n           corresponding `.rst` file.\r\n- [ ] I've made sure the tests are passing. Note that there might be a\r\nfew flaky tests, see the recent failures at https://flakey-tests.ray.io/\r\n- Testing Strategy\r\n   - [ ] Unit tests\r\n   - [ ] Release tests\r\n   - [ ] This PR is not tested :(\r\n\r\n---------\r\n\r\nSigned-off-by: Gene Su <e870252314@gmail.com>\r\nSigned-off-by: Gene Der Su <gdsu@ucdavis.edu>\r\nCo-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>","shortMessageHtmlLink":"[Serve] create internal request id to track request objects (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2336608668\" data-permission-text=\"Title is private\" data-url=\"https://github.com/ray-project/ray/issues/45761\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/ray-project/ray/pull/45761/hovercard\" href=\"https://github.com/ray-project/ray/pull/45761\">#45761</a>)"}},{"before":"3083a8656a816656f80daf3ef7a39a20da152f1b","after":"7b9ad0008b9c8701a83455d8a04c34bfcc6c12ad","ref":"refs/heads/lonnie-240517-ubuntup","pushedAt":"2024-06-10T18:01:55.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"aslonnie","name":"Lonnie Liu","path":"/aslonnie","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/95255098?s=80&v=4"},"commit":{"message":"22.04","shortMessageHtmlLink":"22.04"}},{"before":"829ac71386d330fe4e2a7e669b77422c8a94c1f6","after":"2bb18d1767a6f76af2027efa19bf896d89057085","ref":"refs/heads/master","pushedAt":"2024-06-10T17:26:43.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"angelinalg","name":null,"path":"/angelinalg","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/122562471?s=80&v=4"},"commit":{"message":"[docs] add LLM to example title for easy skimming (#45813)\n\nJust noticed that we had trouble finding the LLM model in the Serve\r\nexamples page, but it was because we were pattern matching for `LLM`,\r\nnot `Large Language Models`.\r\ncc: @GokuMohandas \r\n\r\n## Checks\r\n\r\n- [ ] I've signed off every commit(by using the -s flag, i.e., `git\r\ncommit -s`) in this PR.\r\n- [ ] I've run `scripts/format.sh` to lint the changes in this PR.\r\n- [ ] I've included any doc changes needed for\r\nhttps://docs.ray.io/en/master/.\r\n- [ ] I've added any new APIs to the API Reference. For example, if I\r\nadded a\r\nmethod in Tune, I've added it in `doc/source/tune/api/` under the\r\n           corresponding `.rst` file.\r\n- [ ] I've made sure the tests are passing. Note that there might be a\r\nfew flaky tests, see the recent failures at https://flakey-tests.ray.io/\r\n- Testing Strategy\r\n   - [ ] Unit tests\r\n   - [ ] Release tests\r\n   - [ ] This PR is not tested :(\r\n\r\nSigned-off-by: angelinalg <angelina@anyscale.com>\r\nCo-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>","shortMessageHtmlLink":"[docs] add LLM to example title for easy skimming (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2341216523\" data-permission-text=\"Title is private\" data-url=\"https://github.com/ray-project/ray/issues/45813\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/ray-project/ray/pull/45813/hovercard\" href=\"https://github.com/ray-project/ray/pull/45813\">#45813</a>)"}},{"before":"05556d1b66bd0635210181c915784fe86dd28de8","after":"3083a8656a816656f80daf3ef7a39a20da152f1b","ref":"refs/heads/lonnie-240517-ubuntup","pushedAt":"2024-06-10T17:08:59.000Z","pushType":"push","commitsCount":5,"pusher":{"login":"aslonnie","name":"Lonnie Liu","path":"/aslonnie","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/95255098?s=80&v=4"},"commit":{"message":"Merge remote-tracking branch 'origin/master' into lonnie-240517-ubuntup","shortMessageHtmlLink":"Merge remote-tracking branch 'origin/master' into lonnie-240517-ubuntup"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAAEYabXhgA","startCursor":null,"endCursor":null}},"title":"Activity · ray-project/ray"}