How to embed fluxlang into your own Go service

snonux · September 11, 2021, 5:52am

Hi,

I was wondering if it is a valid use case to embed Fluxlang into your own separate Go service. I am thinking of building new service speaking Fluxlang and for this I would need to embed it. I had a look at GitHub but could not find any examples of how to embed the language besides of the original flux commands.

Cheers,

Paul

Anaisdg · September 13, 2021, 7:00pm

Hello @snonux,
Welcome!
I’m not sure. I’m asking around.

jonathan · September 13, 2021, 7:37pm

Hi, if you want to embed Flux into your own Go service, you can take a look at InfluxDB and see how it does it. In general, the only part that is a bit strange is that we use this utility to compile and link in the Rust components of Flux.

Some links to the integration in InfluxDB:

github.com

influxdata/influxdb/blob/master/cmd/influxd/launcher/cmd.go#L12


      
          
          
import (
          	"context"
          	"fmt"
          	"os"
          	"path/filepath"
          	"strings"
          	"time"
          
          
	"github.com/influxdata/influxdb/v2/bolt"
          	"github.com/influxdata/influxdb/v2/fluxinit"
          	"github.com/influxdata/influxdb/v2/internal/fs"
          	"github.com/influxdata/influxdb/v2/kit/cli"
          	"github.com/influxdata/influxdb/v2/kit/signals"
          	influxlogger "github.com/influxdata/influxdb/v2/logger"
          	"github.com/influxdata/influxdb/v2/pprof"
          	"github.com/influxdata/influxdb/v2/sqlite"
          	"github.com/influxdata/influxdb/v2/storage"
          	"github.com/influxdata/influxdb/v2/v1/coordinator"
          	"github.com/influxdata/influxdb/v2/vault"
          	"github.com/spf13/cobra"

github.com

influxdata/influxdb/blob/ccd96929c547f60d38bbbc6f77738b18c9ab4d40/http/query_handler.go#L131-L223


      
          func (h *FluxHandler) handleQuery(w http.ResponseWriter, r *http.Request) {
          	const op = "http/handlePostQuery"
          	span, r := tracing.ExtractFromHTTPRequest(r, "FluxHandler")
          	defer span.Finish()
          
          
	ctx := r.Context()
          	log := h.log.With(logger.TraceFields(ctx)...)
          	if id, _, found := tracing.InfoFromContext(ctx); found {
          		w.Header().Set(traceIDHeader, id)
          	}
          
          
	// TODO(desa): I really don't like how we're recording the usage metrics here
          	// Ideally this will be moved when we solve https://github.com/influxdata/influxdb/issues/13403
          	var orgID platform.ID
          	var requestBytes int
          	sw := kithttp.NewStatusResponseWriter(w)
          	w = sw
          	defer func() {
          		h.EventRecorder.Record(ctx, metric.Event{
          			OrgID:         orgID,

This file has been truncated. show original

This will hopefully get you started. The flux cli program is probably a bad place to start because it uses the REPL and the REPL isn’t really something that you want to include in an embedded service.

jonathan · September 13, 2021, 7:39pm

Also, just note that the flux library itself if at v0 so it’s possible we will break Go APIs. We generally try not to because it makes maintaining InfluxDB itself more difficult and it doesn’t happen that frequently to begin with, but we sometimes update InfluxDB after making a breaking change to Flux.

snonux · September 16, 2021, 7:52pm

Thanks, I will have a look!

Topic		Replies	Views
Extending flux with Go! Fluxlang	0	568	November 26, 2018
How to use Flux standard library	2	474	June 10, 2020
How to execute flux queries from Golang Fluxlang query	0	682	June 21, 2019
Standardize on a github topic called fluxlang? Fluxlang	0	509	June 13, 2019
Flux Custom Functions and Packages InfluxDB 2 flux	9	1941	December 3, 2020

How to embed fluxlang into your own Go service

Related Topics