LLM

[fuyukawasann]

LLM 종류 선택, 사용 목적(?) 등 방향성을 정하는 이슈

[fuyukawasann]

Jetson Nano에서는 NanoLLM을 통해 구현했을 때 원활히 구현할 수 있다. 현재 테스트는 DistilBERT를 해보았고, DistilBERT는 기본적으로 감정만을 표현하지만, 내용 요약으로도 활용할 수 있다.

BERT의 지식을 증류한 더 작은 모델로, BERT의 97% 성능을 유지하면서 40% 더 작고 60% 더 빠르다.

[fuyukawasann]

LLM을 위해 speech-to-text를 해야 하는데, Deepspeech는 영어만 지원함. 그래서 VOSK를 테스트 하는 중

[fuyukawasann]

vosk는 한국어를 잘 인식하지만, 매우 부정확함 다른 모델 탐색 필요

[fuyukawasann]

Whisper를 고려해보자

[fuyukawasann]

https://huggingface.co/MLP-KTLim/llama-3-Korean-Bllossom-8B

llama3 기반으로 한영 모두 인식하는 LLM인데 테스트 결과 매우 동작 잘함

[ghijkli]

'Although a common set of hardware technologies (see Sections 1.4 and 1.5) is used in computers ranging from smart home appliances to cell phones to the largest supercomputers, these diff erent applications have diff erent design requirements and employ the core hardware technologies in diff erent ways. Broadly speaking, computers are used in three diff erent classes of applications. Personal computers (PCs) are possibly the best known form of computing, which readers of this book have likely used extensively. Personal computers emphasize delivery of good performance to single users at low cost and usually execute third-party soft ware. Th is class of computing drove the evolution of many computing technologies, which is only about 35 years old! Servers are the modern form of what were once much larger computers, and are usually accessed only via a network. Servers are oriented to carrying large workloads, which may consist of either single complex applications—usually a scientifi c or engineering application—or handling many small jobs, such as would occur in building a large web server. Th ese applications are usually based on soft ware from another source (such as a database or simulation system), but are oft en modifi ed or customized for a particular function. Servers are built from the same basic technology as desktop computers, but provide for greater computing, storage, and input/output capacity. In general, servers also place a greater emphasis on dependability, since a crash is usually more costly than it would be on a singleuser PC. Servers span the widest range in cost and capability. At the low end, a server may be little more than a desktop computer without a screen or keyboard and cost a thousand dollars. Th ese low-end servers are typically used for fi le storage, small business applications, or simple web serving (see Section 6.10). At the other extreme are supercomputers, which at the present consist of tens of thousands of processors and many terabytes of memory, and cost tens to hundreds of millions of dollars. Supercomputers are usually used for high-end scientifi c and engineering calculations, such as weather forecasting, oil exploration, protein structure determination, and other large-scale problems. Although such supercomputers represent the peak of computing capability, they represent a relatively small fraction of the servers and a relatively small fraction of the overall computer market in terms of total revenue. Embedded computers are the largest class of computers and span the widest range of applications and performance. Embedded computers include the microprocessors found in your car, the computers in a television set, and the networks of processors that control a modern airplane or cargo ship. Embedded computing systems are designed to run one application or one set of related applications that are normally integrated with the hardware and delivered as a single system; thus, despite the large number of embedded computers, most users never really see that they are using a computer! Most programming languages have a case or switch statement that allows the programmer to select one of many alternatives depending on a single value. Th e simplest way to implement switch is via a sequence of conditional tests, turning the switch statement into a chain of if-then-else statements. Sometimes the alternatives may be more effi ciently encoded as a table of addresses of alternative instruction sequences, called a jump address table or jump table, and the program needs only to index into the table and then jump to the appropriate sequence. Th e jump table is then just an array of words containing addresses that correspond to labels in the code. Th e program loads the appropriate entry from the jump table into a register. It then needs to jump using the address in the register. To support such situations, computers like MIPS include a jump register instruction (jr), meaning an unconditional jump to the address specifi ed in a register. Then it jumps to the proper address using this instruction. We’ll see an even more popular use of jr in the next section. The jr instruction is used to jump to the address specifi ed in a register. The jr instruction is used to jump to the address specifi ed in a register. The jr instruction is used to jump to the address specifi ed in a register. The jr instruction is used to jump to the address specifi ed in a register. The jr instruction is used to jump to the address specifi ed in a register. The jr instruction is used to jump to the address specifi ed in a register. The jr instruction is used to jump to the address specifi ed in a register. The jr instruction is used to jump to the address specifi ed in a register. The jr instruction is used to jump to the address specifi ed in a register. The jr instruction is used to jump to the address specifi ed in a register. The jr instruction is used to jump to the address specifi ed in a register. The jr instruction is used to jump to the address specifi ed in a register. The jr instruction is used to

gpt2 summary의 생성능력

[fuyukawasann]

'Although a common set of hardware technologies (see Sections 1.4 and 1.5) is used in computers ranging from smart home appliances to cell phones to the largest supercomputers, these diff erent applications have diff erent design requirements and employ the core hardware technologies in diff erent ways. Broadly speaking, computers are used in three diff erent classes of applications. Personal computers (PCs) are possibly the best known form of computing, which readers of this book have likely used extensively. Personal computers emphasize delivery of good performance to single users at low cost and usually execute third-party soft ware. Th is class of computing drove the evolution of many computing technologies, which is only about 35 years old! Servers are the modern form of what were once much larger computers, and are usually accessed only via a network. Servers are oriented to carrying large workloads, which may consist of either single complex applications—usually a scientifi c or engineering application—or handling many small jobs, such as would occur in building a large web server. Th ese applications are usually based on soft ware from another source (such as a database or simulation system), but are oft en modifi ed or customized for a particular function. Servers are built from the same basic technology as desktop computers, but provide for greater computing, storage, and input/output capacity. In general, servers also place a greater emphasis on dependability, since a crash is usually more costly than it would be on a singleuser PC. Servers span the widest range in cost and capability. At the low end, a server may be little more than a desktop computer without a screen or keyboard and cost a thousand dollars. Th ese low-end servers are typically used for fi le storage, small business applications, or simple web serving (see Section 6.10). At the other extreme are supercomputers, which at the present consist of tens of thousands of processors and many terabytes of memory, and cost tens to hundreds of millions of dollars. Supercomputers are usually used for high-end scientifi c and engineering calculations, such as weather forecasting, oil exploration, protein structure determination, and other large-scale problems. Although such supercomputers represent the peak of computing capability, they represent a relatively small fraction of the servers and a relatively small fraction of the overall computer market in terms of total revenue. Embedded computers are the largest class of computers and span the widest range of applications and performance. Embedded computers include the microprocessors found in your car, the computers in a television set, and the networks of processors that control a modern airplane or cargo ship. Embedded computing systems are designed to run one application or one set of related applications that are normally integrated with the hardware and delivered as a single system; thus, despite the large number of embedded computers, most users never really see that they are using a computer! Most programming languages have a case or switch statement that allows the programmer to select one of many alternatives depending on a single value. Th e simplest way to implement switch is via a sequence of conditional tests, turning the switch statement into a chain of if-then-else statements. Sometimes the alternatives may be more effi ciently encoded as a table of addresses of alternative instruction sequences, called a jump address table or jump table, and the program needs only to index into the table and then jump to the appropriate sequence. Th e jump table is then just an array of words containing addresses that correspond to labels in the code. Th e program loads the appropriate entry from the jump table into a register. It then needs to jump using the address in the register. To support such situations, computers like MIPS include a jump register instruction (jr), meaning an unconditional jump to the address specifi ed in a register. Then it jumps to the proper address using this instruction. We’ll see an even more popular use of jr in the next section. The jr instruction is used to jump to the address specifi ed in a register. The jr instruction is used to jump to the address specifi ed in a register. The jr instruction is used to jump to the address specifi ed in a register. The jr instruction is used to jump to the address specifi ed in a register. The jr instruction is used to jump to the address specifi ed in a register. The jr instruction is used to jump to the address specifi ed in a register. The jr instruction is used to jump to the address specifi ed in a register. The jr instruction is used to jump to the address specifi ed in a register. The jr instruction is used to jump to the address specifi ed in a register. The jr instruction is used to jump to the address specifi ed in a register. The jr instruction is used to jump to the address specifi ed in a register. The jr instruction is used to jump to the address specifi ed in a register. The jr instruction is used to

gpt2 summary의 생성능력

이게 요약본인거야 아니면 사진의 오른쪽이 요약본인거야?

[ghijkli]

이게 요약본인거야 아니면 사진의 오른쪽이 요약본인거야?

특정한 언급이 없다면 주석처리 되어있는 것이 인풋

[fuyukawasann]

종료 취소