Trying a Local LLM

1
{ pkgs, ... }:
2

3
{
4
  home.packages = with pkgs; [
5
    ollama
6
  ];
7
}

1
$ ollama --version
2
Warning: could not connect to a running Ollama instance
3
Warning: client version is 0.3.12

1
$ ollama pull qwen2.5-coder:32b

1
$ ollama serve

1
$ ollama serve
2
2024/11/16 21:53:13 routes.go:1153: INFO server config env="map[HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_DEBUG:false OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://127.0.0.1:11434 OLLAMA_KEEP_ALIVE:5m0s OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/Users/suzumiyaaoba/.ollama/models OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:0 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://*] OLLAMA_SCHED_SPREAD:false OLLAMA_TMPDIR: http_proxy: https_proxy: no_proxy:]"
3
time=2024-11-16T21:53:13.738+09:00 level=INFO source=images.go:753 msg="total blobs: 8"
4
time=2024-11-16T21:53:13.738+09:00 level=INFO source=images.go:760 msg="total unused blobs removed: 0"
5
time=2024-11-16T21:53:13.738+09:00 level=INFO source=routes.go:1200 msg="Listening on 127.0.0.1:11434 (version 0.3.12)"
6
time=2024-11-16T21:53:13.739+09:00 level=INFO source=common.go:135 msg="extracting embedded files" dir=/var/folders/9f/5ppq6dg904l3bp8t3zxhbzw40000gn/T/ollama1365314392/runners
7
time=2024-11-16T21:53:13.758+09:00 level=INFO source=common.go:49 msg="Dynamic LLM libraries" runners=[metal]
8
time=2024-11-16T21:53:13.771+09:00 level=INFO source=types.go:107 msg="inference compute" id=0 library=metal variant="" compute="" driver=0.0 name="" total="48.0 GiB" available="48.0 GiB"

1
$ ollama run qwen2.5-coder:32b

1
ollama run qwen2.5-coder:32b
2
>>> Send a message (/? for help)

1
$ ollama run qwen2.5-coder:32b
2
>>> Please write Hello, World using Java
3
Certainly! Here is a simple "Hello, World" program in Java:
4

5
```java
6
public class HelloWorld {
7
    public static void main(String[] args) {
8
        System.out.println("Hello, World");
9
    }
10
}
11
```
12

13
To run this program, follow these steps:
14

15
1. Save the code in a file named `HelloWorld.java`.
16
2. Open a terminal or command prompt and navigate to the directory where you saved the file.
17
3. Compile the Java program using the Java compiler with the following command:
18
   ```sh
19
   javac HelloWorld.java
20
   ```
21
4. Run the compiled Java program with the following command:
22
   ```sh
23
   java HelloWorld
24
   ```
25

26
You should see the output:
27
```text
28
Hello, World
29
```

1
>>> Write code in Java to output 100 Fibonacci numbers
2
Certainly! To generate and print the first 100 Fibonacci numbers in Java, you can use a simple loop. Here's a complete Java program that does this:
3

4
```java
5
public class Fibonacci {
6
    public static void main(String[] args) {
7
        int n = 100; // Number of Fibonacci numbers to print
8
        long[] fibonacciSeries = new long[n];
9

10
        // Initialize the first two Fibonacci numbers
11
        if (n > 0) {
12
            fibonacciSeries[0] = 0;
13
        }
14
        if (n > 1) {
15
            fibonacciSeries[1] = 1;
16
        }
17

18
        // Calculate the rest of the Fibonacci series
19
        for (int i = 2; i < n; i++) {
20
            fibonacciSeries[i] = fibonacciSeries[i - 1] + fibonacciSeries[i - 2];
21
        }
22

23
        // Print the Fibonacci series
24
        System.out.println("The first " + n + " Fibonacci numbers are:");
25
        for (int i = 0; i < n; i++) {
26
            System.out.print(fibonacciSeries[i] + " ");
27
        }
28
    }
29
}
30
```
31

32
### Explanation:
33
1. **Initialization**: The first two Fibonacci numbers are initialized as `0` and `1`.
34
2. **Loop to Calculate Series**: A loop runs from index `2` to `n-1` to calculate the remaining Fibonacci numbers by summing the two preceding numbers.
35
3. **Output**: Another loop prints out all 100 Fibonacci numbers.
36

37
### Steps to Run:
38
1. Save the code in a file named `Fibonacci.java`.
39
2. Open a terminal or command prompt and navigate to the directory where you saved the file.
40
3. Compile the Java program using the Java compiler with the following command:
41
   ```sh
42
   javac Fibonacci.java
43
   ```
44
4. Run the compiled Java program with the following command:
45
   ```sh
46
   java Fibonacci
47
   ```
48

49
This will print the first 100 Fibonacci numbers to the console.