Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
62 commits
Select commit Hold shift + click to select a range
dbd09de
release: version 0.0.5 (#91)
ycjcl868 Feb 12, 2025
e4294ac
bump: v0.0.5
ycjcl868 Feb 12, 2025
e9a5e4e
fix(share): not use system picker (#101)
ycjcl868 Feb 12, 2025
b2203cf
chore: menu label
ycjcl868 Feb 12, 2025
741bd8d
chore: tweak setting doc and utio types (#102)
ulivz Feb 13, 2025
000f1a1
update discord link
mingcomplex Feb 13, 2025
69b5bd7
docs: brew install (#103)
ycjcl868 Feb 13, 2025
9b65d72
feat(renderer): add a strong prompt when the report needs to be uploa…
ulivz Feb 14, 2025
e378581
docs: contributing.md (#106)
ycjcl868 Feb 14, 2025
fe32e71
fix(operator): typing and key input fail (#112)
5101good Feb 18, 2025
a6a42b1
feat: enable easy copying of images to clipboard
Dugyu Feb 18, 2025
7c419a3
feat: copy image to clipboard error warning using useToast from chakra
Dugyu Feb 18, 2025
49f1d7b
feat: image copy to clipboard useToast common settings
Dugyu Feb 18, 2025
5976be4
fix(bug): ensure screen capture uses primary display source (#117)
skychx Feb 19, 2025
9590749
tweak(ux): close Settings Window after saving (#115)
ZhaoHeh Feb 19, 2025
448302d
feat(visualizer): reduce html report size (close: #118) (#119)
skychx Feb 19, 2025
16d7545
feat: add ui-tars GUI Agent SDK (#110)
ycjcl868 Feb 20, 2025
107c049
release: 0.0.6 (#120)
ycjcl868 Feb 20, 2025
756ccc4
docs: add sdk graph (#121)
ycjcl868 Feb 20, 2025
d169e46
chore: cli esm bug and sdk docs (#122)
ycjcl868 Feb 20, 2025
0302bfe
chore: remove video (#123)
ycjcl868 Feb 20, 2025
75a6c86
fix(operator): macos cannot type (#126)
ycjcl868 Feb 21, 2025
b6ab180
docs: fixed the rfc document format issue (#130)
WillemJiang Feb 23, 2025
5e7f016
docs: Added SECURITY policy file (#131)
WillemJiang Feb 23, 2025
4e0883f
feat: support operator-browserbase (#132)
ycjcl868 Feb 25, 2025
946bbe7
refactor: sdk replace FACTOR to FACTORS(no breaking) (#137)
ycjcl868 Feb 26, 2025
a795c36
chore: apply security best practices (#135)
step-security-bot Feb 26, 2025
83f0bc6
Revert "chore: apply security best practices (#135)" (#157)
ycjcl868 Feb 26, 2025
9c5f8f4
fix(sdk): should respect model's factors config (#159)
ulivz Feb 27, 2025
2845023
fix(action-parser): box coordinates normalization (#161)
ulivz Feb 28, 2025
3327d9d
feat(sdk): allow custom factors via `parseBoxToScreenCoords` api (#162)
ulivz Feb 28, 2025
c050e6a
release: beta sdk (#160)
ycjcl868 Feb 28, 2025
f967638
chore(deps): bump actions/checkout and ossf/scorecard-action (#158)
WillemJiang Feb 28, 2025
cb4439a
test: add unit tests for screen and permission ipcRoutes (#138)
WillemJiang Feb 28, 2025
d671c7a
docs: contribute for building (#169)
ycjcl868 Mar 3, 2025
1392f93
fix(screenshot): screenshot thumbnail undefined (#170)
ycjcl868 Mar 4, 2025
ec731b4
chore: add new action for secret scanning (#166)
WillemJiang Mar 4, 2025
2bf2f4a
refactor(sdk): screenshot only return base64 and scaleFactor (#171)
ycjcl868 Mar 6, 2025
572683e
update: sdk.md (#173)
ycjcl868 Mar 6, 2025
4566bda
refactor(monorepo): migrate to apps/desktop (#177)
ycjcl868 Mar 16, 2025
e651213
fix: native module deps build and reduce 28% bundle size (#181)
ycjcl868 Mar 16, 2025
e7b736c
chore: fix logo url (#187)
ulivz Mar 17, 2025
e60848c
fix: electron build issue & tweak sdk snapshot quality (#188)
ycjcl868 Mar 17, 2025
2b9c631
release: v0.0.7 (#189)
ycjcl868 Mar 17, 2025
4135a0d
feat: init `@agent-infra/shared`package
ycjcl868 Mar 17, 2025
cc7623b
feat(@agent-infra/shared): add agent related methods
sanyuan0704 Mar 16, 2025
cbe184a
feat(@agent-infra/shared): add mcp related methods
ycjcl868 Mar 16, 2025
7ecb06c
feat(agent-infra): init logger
ycjcl868 Mar 17, 2025
6a60723
feat(agent-infra): init browser
ulivz Mar 16, 2025
0062cf9
feat(agent-infra): init search
ulivz Mar 16, 2025
cd11cff
feat: browser use and mcp client & servers (#186)
ycjcl868 Mar 17, 2025
75b46e9
fix(mcp-browser): browser relaunch when session closed (#192)
ycjcl868 Mar 17, 2025
9989aba
feat: agent tars app (#191)
sanyuan0704 Mar 17, 2025
f4201ca
fix(ci): monorepo version error (#194)
ycjcl868 Mar 17, 2025
f244901
fix(app): electron build error (#199)
ycjcl868 Mar 18, 2025
a84649b
fix: clear the canvas display when deleting the history records (#197)
skychx Mar 18, 2025
ba35550
fix: the replay page supports pause and resume (#198)
skychx Mar 18, 2025
ddd1ebf
chore: release app action (#200)
ycjcl868 Mar 18, 2025
babd07a
chore: refine files structure for desktop app (#201)
ulivz Mar 18, 2025
11d1300
feat(ui-tars): browser operator (#195)
ulivz Mar 18, 2025
5c8ef49
feat: init browser agent core
ulivz Mar 18, 2025
20bb3e3
feat: init `@ui-tars/browser-gui-agent`
ulivz Mar 18, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
11 changes: 9 additions & 2 deletions .changeset/config.json
Original file line number Diff line number Diff line change
Expand Up @@ -2,12 +2,19 @@
"$schema": "https://unpkg.com/@changesets/config@3.0.5/schema.json",
"changelog": "@changesets/cli/changelog",
"commit": false,
"fixed": [],
"fixed": [
[
"@ui-tars/*",
"!@ui-tars/visualizer"
]
],
"linked": [],
"access": "restricted",
"baseBranch": "main",
"updateInternalDependencies": "patch",
"ignore": [
"ui-tars-desktop"
"ui-tars-desktop",
"ui-tars-desktop-renderer",
"@common/*"
]
}
12 changes: 12 additions & 0 deletions .changeset/dull-lions-tie.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
---
'@ui-tars/operator-browserbase': patch
'@ui-tars/operator-nut-js': patch
'@ui-tars/action-parser': patch
'@ui-tars/electron-ipc': patch
'@ui-tars/shared': patch
'@ui-tars/utio': patch
'@ui-tars/cli': patch
'@ui-tars/sdk': patch
---

chore: same version
9 changes: 9 additions & 0 deletions .changeset/fast-insects-flash.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
---
'@ui-tars/operator-browserbase': patch
'@ui-tars/operator-nut-js': patch
'@ui-tars/shared': patch
'@ui-tars/cli': patch
'@ui-tars/sdk': patch
---

chore: open-operator
12 changes: 12 additions & 0 deletions .changeset/forty-toys-watch.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
---
'@ui-tars/operator-browserbase': patch
'@ui-tars/operator-nut-js': patch
'@ui-tars/action-parser': patch
'@ui-tars/electron-ipc': patch
'@ui-tars/shared': patch
'@ui-tars/utio': patch
'@ui-tars/cli': patch
'@ui-tars/sdk': patch
---

feat(sdk): action parser add start_coords, end_coords
12 changes: 12 additions & 0 deletions .changeset/four-hairs-dance.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
---
'@ui-tars/operator-browserbase': patch
'@ui-tars/operator-nut-js': patch
'@ui-tars/shared': patch
'@ui-tars/sdk': patch
'@ui-tars/action-parser': patch
'@ui-tars/cli': patch
'@ui-tars/electron-ipc': patch
'@ui-tars/utio': patch
---

refactor: operator no need return width and height
12 changes: 12 additions & 0 deletions .changeset/hip-pumas-check.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
---
'@ui-tars/operator-browserbase': patch
'@ui-tars/operator-nut-js': patch
'@ui-tars/action-parser': patch
'@ui-tars/electron-ipc': patch
'@ui-tars/shared': patch
'@ui-tars/utio': patch
'@ui-tars/cli': patch
'@ui-tars/sdk': patch
---

chore: screenshot bug
5 changes: 5 additions & 0 deletions .changeset/lemon-swans-chew.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
---
'@ui-tars/sdk': patch
---

chore: factors
5 changes: 5 additions & 0 deletions .changeset/modern-zebras-guess.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
---
'@ui-tars/sdk': patch
---

chore: factors
34 changes: 34 additions & 0 deletions .changeset/pre.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,34 @@
{
"mode": "exit",
"tag": "beta",
"initialVersions": {
"ui-tars-desktop": "0.0.7-beta.2",
"ui-tars-desktop-renderer": "0.0.1",
"@common/configs": "0.0.1",
"@common/electron-build": "1.0.0",
"@ui-tars/action-parser": "1.2.0-beta.21",
"@ui-tars/cli": "1.2.0-beta.21",
"@ui-tars/electron-ipc": "1.2.0-beta.21",
"@ui-tars/operator-browserbase": "1.2.0-beta.21",
"@ui-tars/operator-nut-js": "1.2.0-beta.21",
"@ui-tars/sdk": "1.2.0-beta.21",
"@ui-tars/shared": "1.2.0-beta.21",
"@ui-tars/utio": "1.2.0-beta.21"
},
"changesets": [
"dull-lions-tie",
"fast-insects-flash",
"forty-toys-watch",
"four-hairs-dance",
"hip-pumas-check",
"lemon-swans-chew",
"modern-zebras-guess",
"pretty-brooms-brush",
"selfish-cups-divide",
"selfish-humans-drive",
"short-shoes-tap",
"stale-icons-whisper",
"strange-schools-help",
"witty-points-rescue"
]
}
12 changes: 12 additions & 0 deletions .changeset/pretty-brooms-brush.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
---
'@ui-tars/operator-browserbase': patch
'@ui-tars/operator-nut-js': patch
'@ui-tars/action-parser': patch
'@ui-tars/electron-ipc': patch
'@ui-tars/shared': patch
'@ui-tars/utio': patch
'@ui-tars/cli': patch
'@ui-tars/sdk': patch
---

fix: test
12 changes: 12 additions & 0 deletions .changeset/selfish-cups-divide.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
---
'@ui-tars/operator-browserbase': patch
'@ui-tars/operator-nut-js': patch
'@ui-tars/cli': patch
'@ui-tars/sdk': patch
'@ui-tars/action-parser': patch
'@ui-tars/electron-ipc': patch
'@ui-tars/shared': patch
'@ui-tars/utio': patch
---

feat: sdk factors version
11 changes: 11 additions & 0 deletions .changeset/selfish-humans-drive.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
---
'@ui-tars/action-parser': patch
'@ui-tars/cli': patch
'@ui-tars/electron-ipc': patch
'@ui-tars/operator-nut-js': patch
'@ui-tars/sdk': patch
'@ui-tars/shared': patch
'@ui-tars/utio': patch
---

bump: sdk support
7 changes: 7 additions & 0 deletions .changeset/short-shoes-tap.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
---
'@ui-tars/operator-browserbase': patch
'@ui-tars/operator-nut-js': patch
'@ui-tars/sdk': patch
---

chore: types
12 changes: 12 additions & 0 deletions .changeset/stale-icons-whisper.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
---
'@ui-tars/action-parser': patch
'@ui-tars/cli': patch
'@ui-tars/electron-ipc': patch
'@ui-tars/operator-browserbase': patch
'@ui-tars/operator-nut-js': patch
'@ui-tars/sdk': patch
'@ui-tars/shared': patch
'@ui-tars/utio': patch
---

chore: changeset
5 changes: 5 additions & 0 deletions .changeset/strange-schools-help.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
---
'@ui-tars/cli': patch
---

chore: node-fetch
6 changes: 6 additions & 0 deletions .changeset/witty-points-rescue.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
---
'@ui-tars/cli': patch
'@ui-tars/sdk': patch
---

update
2 changes: 1 addition & 1 deletion .github/workflows/e2e.yml
Original file line number Diff line number Diff line change
Expand Up @@ -44,4 +44,4 @@ jobs:
- name: Install dependencies
run: pnpm install
- name: Run e2e
run: pnpm run test:e2e
run: cd apps/ui-tars && pnpm run test:e2e
101 changes: 101 additions & 0 deletions .github/workflows/release-agent-tars.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,101 @@
name: Release Agent-TARS app
on:
# push:
# branches:
# - main
workflow_dispatch:

env:
CI: true
NODE_OPTIONS: --max-old-space-size=8192
HUSKY: 0

permissions:
id-token: write
contents: write
attestations: write

jobs:
publish_on_mac:
strategy:
fail-fast: false
matrix:
os: [macos-latest]
runs-on: ${{ matrix.os }}
steps:
- uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
- name: Show operating system info
run: |
echo "Operating System:"
uname -a
- name: Install pnpm
run: npm install -g pnpm@9
- uses: actions/setup-node@1d0ff469b7ec7b3cb9d8673fde0c81c44821de2a # v4.2.0
with:
node-version: 20
cache: 'pnpm'
- name: Install Python setuptools
run: brew install python-setuptools
- name: Install appdmg
run: npm install -g appdmg
- name: Install the Apple certificate and provisioning profile
env:
BUILD_CERTIFICATE_BASE64: ${{ secrets.BUILD_CERTIFICATE_BASE64 }}
P12_PASSWORD: ${{ secrets.P12_PASSWORD }}
BUILD_PROVISION_PROFILE_BASE64: ${{ secrets.BUILD_PROVISION_PROFILE_BASE64 }}
KEYCHAIN_PASSWORD: ${{ secrets.KEYCHAIN_PASSWORD }}
run: |
# create variables
CERTIFICATE_PATH=$RUNNER_TEMP/build_certificate.p12
PP_PATH=$RUNNER_TEMP/build_pp.mobileprovision
KEYCHAIN_PATH=$RUNNER_TEMP/app-signing.keychain-db

# import certificate and provisioning profile from secrets
echo -n "$BUILD_CERTIFICATE_BASE64" | base64 --decode -o $CERTIFICATE_PATH
echo -n "$BUILD_PROVISION_PROFILE_BASE64" | base64 --decode -o $PP_PATH

# create temporary keychain
security create-keychain -p "$KEYCHAIN_PASSWORD" $KEYCHAIN_PATH
security set-keychain-settings -lut 21600 $KEYCHAIN_PATH
security unlock-keychain -p "$KEYCHAIN_PASSWORD" $KEYCHAIN_PATH

# import certificate to keychain
security import $CERTIFICATE_PATH -P "$P12_PASSWORD" -A -t cert -f pkcs12 -k $KEYCHAIN_PATH
security set-key-partition-list -S apple-tool:,apple: -k "$KEYCHAIN_PASSWORD" $KEYCHAIN_PATH
security list-keychain -d user -s $KEYCHAIN_PATH

# apply provisioning profile
mkdir -p ~/Library/MobileDevice/Provisioning\ Profiles
cp $PP_PATH ~/Library/MobileDevice/Provisioning\ Profiles
- name: install dependencies
run: pnpm install
- name: publish arm64
env:
APPLE_ID: ${{ secrets.APPLE_ID }}
APPLE_PASSWORD: ${{ secrets.APPLE_PASSWORD }}
APPLE_TEAM_ID: ${{ secrets.APPLE_TEAM_ID }}
KEYCHAIN_PATH: ${{ runner.temp }}/app-signing.keychain-db
GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
run: |
cd apps/omega && pnpm run publish:mac

# publish_on_win:
# runs-on: windows-latest
# steps:
# - uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
# - name: Show operating system info
# run: |
# echo "Operating System:"
# cmd /c ver
# - name: Install pnpm
# run: npm install -g pnpm@9
# - uses: actions/setup-node@1d0ff469b7ec7b3cb9d8673fde0c81c44821de2a # v4.2.0
# with:
# node-version: 20
# cache: 'pnpm'
# - name: install dependencies
# run: pnpm install
# - name: publish
# env:
# GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
# run: cd apps/omega && pnpm run publish:win32
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
name: Release app
name: Release UI-TARS app
on:
# push:
# branches:
Expand Down Expand Up @@ -78,7 +78,7 @@ jobs:
KEYCHAIN_PATH: ${{ runner.temp }}/app-signing.keychain-db
GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
run: |
pnpm run publish:mac-arm64
cd apps/ui-tars && pnpm run publish:mac-arm64
- name: publish x64
if: matrix.os == 'macos-13'
env:
Expand All @@ -88,7 +88,7 @@ jobs:
KEYCHAIN_PATH: ${{ runner.temp }}/app-signing.keychain-db
GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
run: |
pnpm run publish:mac-x64
cd apps/ui-tars && pnpm run publish:mac-x64

publish_on_win:
runs-on: windows-latest
Expand All @@ -109,4 +109,4 @@ jobs:
- name: publish
env:
GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
run: pnpm run publish:win32
run: cd apps/ui-tars && pnpm run publish:win32
4 changes: 2 additions & 2 deletions .github/workflows/scorecard.yml
Original file line number Diff line number Diff line change
Expand Up @@ -32,12 +32,12 @@ jobs:

steps:
- name: "Checkout code"
uses: actions/checkout@b4ffde65f46336ab88eb53be808477a3936bae11 # v4.1.1
uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
with:
persist-credentials: false

- name: "Run analysis"
uses: ossf/scorecard-action@0864cf19026789058feabb7e87baa5f140aac736 # v2.3.1
uses: ossf/scorecard-action@f49aabe0b5af0936a0987cfb85d86b75731b0186 # v2.4.1
with:
results_file: results.sarif
results_format: sarif
Expand Down
22 changes: 22 additions & 0 deletions .github/workflows/secret-scan.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,22 @@
on:
push:
branches:
- main

pull_request:

permissions:
contents: read

jobs:
test:
runs-on: ubuntu-latest
steps:
- name: Checkout code
uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
with:
fetch-depth: 0
- name: Secret Scanning
uses: trufflesecurity/trufflehog@7dc056a193116ba8d82154bf0549381c8fb8545c # v3.88.14
with:
extra_args: --results=verified,unknown
Loading